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-x»± -«±©x v- yum mmv. 

[1*99] 

MafcitffStt&g&ftlcg^^T^fifc^i-LS, l fcCttoMttlSK. 

[IS*9 i o J 

-XttZ£t±©* u-:/MlP«*#Xfc, ^**-$9»«#ia»fc©-Xli-Et±©fr<fr|c: 10 

*aa y y - * ©& 1 7* y h ©aaa y y-^scawtii, 

saa y y-^»iit^ty hroMay y-^iSJoir/iEtty y-xoiityt, h © 
istgy y-^s©t iSrSK^tsfcft©, aa y y~-x<o%ivy-ty h t istt y y - 

' [ n * a 1 1 ] 

*aa y y-^oiit/ty hcoMay y-^gcfcitfiatgy y-^osit^t? h © 
Eft y y-^s©fli5, *&a y y-^os 1 -y-^-t ? t- *s .ttfiaigy y-^oii 20 

ty bOl^roo-r^/lcI^V^t, ^**-fM3i>«l1f?fc:J;oTJg^$ix.5. lit** 
1 0 lcfE©<0$J^^S. 

[»** 12] 

£ 1: t\ aaa y y-^©i2tyty h *j .t ets y y-7n>S2t/tj/ h & 2 
^ayy-^^^-7-Sr?ti:i-5J:5i-«^;$ix-ctJ»), m 2 II y y-x^/u-ytt, 
*aa y y-^»i^i>fi«i!) y-xoi2tyty h &i§« l , 
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•***-tt*i««#, ss 1 nay y-^^j^-y^oa-^^ y^mm^^^Mmmmic 

[It** 16] 



(4) 



JP 2004-508616 A 2004. 3. 18 



istty y-*<z>*-a-a»£>fBfty y-^rogsi-y-y-tr:/ h & it & l . io 

May y-^cgit/t? h SriBit y y-xo$ityty M:ai8i*t m: 

«t o . 

y-^o$if-^t 5 ' h*5it/is«y y-^os&i-y-y-fes/ h&^tfmi^gy y 
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tbtfftibft^. 1fS#tt, SISlc»*!ii-5fc«)|c^lf|5St£4k^^6>!)y-^^S*J 

J:U=^* y y-^Sr^jll-t-5^^*5fo5„ #<©flf li, f » Lftv^-^f B t»t 

a & ft a* e> . rftKioT*teffl©gi:;&s#*ftt>©Kft»K * * :/ tf- * hfc 

[ 0 0 0 5 ] 

ftKftoTP-ro^isw^o^t-v^s&aas&sifts©-?. ^g&sft^mcto-cis 

R © t£ * *5 i Vfi£Sl4fS5¥T-tt:^V^ £ b \z , ^ ffl L ft ^ £ - * fit ^ fc » + 6 & ft 7° 7 V 
= y^t*fcBl*aoTv>S. r©»#, *tt£tt&£i±: *>ft 9 

[ 0 0 0 6 ] 

$ e> k , tvumtt&m&'gm-r z t j h © & g & # a a ft 5 r t # l if l i* & 5 . 
*> s £ g i* . * © * ^ * << h«r»scLTaiti3±««(»i-sfc»©ti*#!e» 

g lc ft * 0 m<o±mx^t. * © ? x.-fVr* Y «r , ^gBSie^^T-*lcS!M$nfcfib,W^T 
©iH' h*»f,»ai$-fr5#3£<oaiS*fclil"<yKO$^5fc«iS£, gifts. giJ©{&J £ LT 

, *>5&ts-cf±, ifr i>i;iai^tife^i^ ^ h v h~omnt£mm&&& t ft*, 
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JP 2004-508616 A 2004. 3. 18 
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ctor, F5Labs£>BigIP, AletonCDWeb Director t£ if X 
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[ 0 0 0 8 ] 

loiiftftftsia^tytojlofrt, HiA, Bib, Biatst, HiAtt* 

^fiTi^aiyf-^h^yn^^iaTfe^, CPU1 0 2^oit;7'f 04^tt?#-O 10 

ayfa-f^y^SSSfcll^v'y l-o 0^6*5, r^yiooii, -f ^ * - * y h 

ilt&e,il5tlfjfiSO/^5; hSSSr-^y h !7 - * 1 0 6, £ tz\*m<0* y V 
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13 1 B 12, «»^)!>x/t-^WS A, WSB. WSCiSr^tpli^x/f^/^y-A 
(■ 1 1 0 <D7 U y # 5 0 # ? a: T^-/*!* v O^^;H06 (Cftl Jhfc-n - 

K'<9 V* 1 1 2I^S5tt*tbTV>5 0 D-F/<7Vfllt-/<||Joh77-f yUftHL 

*IHrS*iTV**v* F77^ y * a> e> «s -f 5 » o 7 7 7 » t-A^tttrfr 20 

[0010] 

HlCtt, ^^t-^Wl, W2K¥<Dm, T 7 y 9 ^ - y< A 1 , A 2 * Z <D 

-To »>*:/■»■ HTTPS*|:»jat5fc»l:RttE)ft5. T^y*--^a>' + - 

-^ll*>^rA (DBMS) y 7 h * * T £3£fl-f 5o 
[0011] 

isKt5jfcs©*5^i^*-< tots© h#py-^^«ftsn % iats^t^^s 

t. ■ [0012] 

0, *fctt*©H©rt©H45^i|-e. **i:*45 u^^o h 7 7 .-f y # fcSftt 5. 

- ? h 7 y * y ? ftm-ei*. t = 7V4h<D^-h*?*T*tzftyyh$=LTi± y * - 

T- 12 , !>xXt>f h©^-K«>x74fciiy7 F>x7ttta«©8iisfc5, + # fc ftj 
ffl*nt^4^„ S6 * O ^ ffi -e li . iaS^=>^hS:AofcOS3IUS4fc>i5rfc4<, tr 40 
- * h?7ofK»*t8 + »4/N-K!>x7feJ:ffy7>!>x7t»t5:ii:«it 
5^5y^S:Eoit5 • fcii, BK&lflfl-CfcS. *<0>x^t>f HH9i/<7y^ 
4rJLott5rfc#-e#1\ *^4ttfciB/^**4fcf±aslld**fc^B*Si^-Cv^a 0 
[0013] 

7^7 r t-/^|:«St5tl©ta-vyi 7 -|:j:!), t-^77 - # lb fE L , 
rnfcctoT^ * ^ -y- h^a--if^(o-y--tf^dS5*cto*tT is 5^itgtt^*>5^ fc -e fc 
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± IE K g -3 t , r © # S K *J 1^ T , * *9 J»mtfLZ&mt-tZ>Ztf£< * ~S * # *> 9 ft ft 

* it ts j; t* g m # w n i- ^ -e *> s „ 

[0015] 

£ ^> »C . 1-77^ y 9 *fr—7 y h © ^fc & $ £ a» K 1" 5 * K * Jx ^ ft & g K J& C T ifc 
[0016] 

[0017] 

#3S93© i oroffi^ic ihtf , ±B&Stt, is J: tf«T©tft9n;i J: •> W ?> i: ft S ffe©i& 
ts^tttsiotstcioTitbhs. nve-a-x-fv-^^y y Kit, fe9ft£«ijft (' 

y Ktt. -Xlira±OVLAN^>f fcit)!-XllZa±©EjgI«* 9 hV- 
0 (SAN) ;Wy*fcM3:fcfc#»fc£S^3>'tf:»-y*>'^»*«:£^-CV»* 20 
„ «&©|at§£lgtt S A N X -f ^ K&iK £ ft. J.O®§J^§J •) D y *j i V ^ v 

LAN^ 5>^©lo©#-Mi, -< >- * - * •;/ h ft if © fl- SB * •> Fl7-^|c:giiR$ti5 
. -> £ fc 12 :7" n -fe ;* |4 , VLAN^^^f^itfSAN^y ^fC| 

[0018] 

uj*ic> &x o&mmmts £v=> >■ ? j >- y&m\t. 74 k /PT'-yncsiostb 

ft5„ 7" D ^7 A«»©T» ESllliVLAN^'f yffc'iySANX'f -y (D /8 — h 

Xli-y±co<ga^-/<7r-A (vsf) Sfcii^y^^y hf-^ty^ (idc) 

© - 65 t ft 5 . ^VSFaVfc-^.-^^ >- :/ g tt , :/ - M h7 3'7 , gl^*JJ;tJ f *fi£ll 
[0019] 

*&W<D 1 ^<Dm%Uz £ % k ^ l£ & Jf 14 , -XI±rW±<Oxu-^$iJ^l^n-lrx^fl|(cii 
7* - >- T- S „ -XI±-^±co^x ; ?-fSiJ®7'n-t:x&1gli, xu-:/fM$l7*D-fexfi£ 

h*a«+Srifc£oTIDC«:*A1-$J:$fc*U-:/IH*p:/nlr*««fc£tti-$ 
&fcfrft5. J£ga s ft A>o fc "9 . 5 VM4£ft»T L fc x y IK ana « US Eft £ n 5 

x u-:/ * -ffl®m®<omm#)t£Wi®t:nt£ ? . * ? - x u-^urn 

[ 0 0 2 0 ] 

^ ^ y s' KpaftSrassioBWtsiAiaacnoatsr ic±9. «■ f - -< h © # * 50 
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#559! li, Ssttw^Elris^x, K£-f-5©Xl4#<, - m k Lt mm £ fix is 9 , io 
[ 0 0 2 2 ) 

«T©RHfc*SV»-C\ I«IS©1WT\ **WSr^±fcH«| LT fc ?> 5 fc * I;: £ & © # £ © 

^atas^^ t,*txvv 5o u^L*^e>. *&w&z tib<o®%:<D®um nznmztih r 
i 14 a si#k w e> a» i # 5 xs> 5 p . tew 01x14, w &*&m ►> t < < tt ^ x 

0 <DZ®m-t Ztilt>\z, RtSiOffi'&Z; XTfmW&s' v y y ®X'& £ tiX ^ Z>. 
I 0 0 2 3 1 
<EiSlf-/<77-A (VSF) 

-mm&Mc £ Z t . *M = > f a - x ^ V >/ «*jg ( r^fa-x^y^/y yKj 
) #RrtfeH5. a ^f^-x^ y 5/ K HtMtt -«* & * *i . 

14 ffi® © * *l K §4 D 13 X 5> ft S 0 &&.U(0 a V f A - X W V i/ if V y K O D i? y ^ » 

#14, 1Si8^-/<7 7 -^ (vsf) tuftfftS. #a»iitrovsF<oifiL-fcif f 

£E1-5£i#X#3. VSFIiB-ollWnyfa-T^ y 7 if y y K e> £ X IS JS 
KM- £ fi£ £ ft 3 # , #VSF(liTOIJi>©ffii©VSFi^«a*JlT^5 0 VSF 14 

> ^^*?h*io»8ovsFi:Sbt:i6< 1 flA*Jfl 01* 
x "^5'^-^ (VPN) 5r^ffi1-5rt(c4t>, >f y h7^y H;ffit88f3^ 
i: * X # 5 „ 
[ 0 0 2 4 ] 

fe'tt 14, 3 y lfa-^/N©^t ( #1 x. If , * - - - -»F £ 14 ^ - M H7^ t^i 
^ffL, UtOayfa-^iggJhfcD-A/Hi);^ n;-^ (LAN) <D± 
xco h 7 7 4 y ? & m&i- Z> k & X' Z Z> i>K *z ft K fij •? £ X h tilt. => > f » - 7- > ^ 
^ y y K © » £ . vsFi;tiit5f-^ii±v = yfa-7^y^g$i:c^7^ 

-fe*x#5„ -Xifliiisf, rfttt. v s f <D&±mR&W>tt\ztZ&*> 4 tfm 5 

>9 K -f > h 7 ^ y h £ 14 i * * h 7 * y (• Sr^ L t 7 ^ t ^ f$ 5ffll©rt 

tir/!)7-^ 3 >SrSffl1-.5ri:^X^5„ 
[ 0 0 2 5 ] 

3yf a -7^y^^ijj±t)!^rogit5*5' h ? - * > ^ , feJ:VIE«Sig©fl}fi£t 
W # »4 , => v tf a — x ^ ^ V V U y h' icia n i> => H' ^. — T ^ > y"^m <DiSftl^{C ji o X 
B»-7^txtS:to-etftv»E8»«i:J:oTfTftlJh5. «*±, *X»Xtt, £ 

s'h!7-:5'd>b«(££ftX^xt>J;^ 0 griffin. ^-/Oc^if, =, ^ h u - 7 t£ k* X 
*j« SftX^Xii^. CwliKStSi^K, ffc©?jrgc£ffl^.5 ^ £ t X# S„ 
[ 0 0 2 6 ] 

«-lT-iI^5. $9 » T u - V 14 , ^y-yK<D^s'h!7-dfv^^ < tUtfB«g*ro#» 
-f V *\ ^5/h^-^y^JoJ;Ut|E1t^^(c^LX. SUffllftfeSr^ft 5 „ UW7" 

•> *r ao§) 13 # is * k ^iW^y^?!-^^^^, y^fAicijitS^yf a-f 
^y/S3t©:ft??«:il8L, ^77-f*/w.3.-if^>^7 3 :-^*fc|4<ae3a«J*3.-f ! 

-r>-^7^-^^ftfflLXji#i : a^ig$r^.^5 o 

[ 0 0 2 7 ] 
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(ovsf) lex «t 5 a > tr * - * ic tt»awfcf**«r»-c*> 9 % ^^-^y^'i: 

LT. fc5V^tt»»3/tfa-?A»b, ftLT*»**LfcD, 
lft*IMHr*Ltfi!, ifttt«SovsFi:*5it5^y/<-^*y^*B«it5. 

[ 0 0 2 8 ] 10 

- t = vf^-x^^^y 5/ K<o««o/n- K * a: r fc*s^-c j&« $ its r * 

[ 0 0 2 9 ] ( 

Mffly # v s f (oft® h #u v-zmwi-z. mm? u- y« c c krw-*- 5 

[ 0 0 3 0 ] 

^>-t: 0 ^-r^>^^y^K«*-^^^fic#^L, ttiti* a* -e* 

-steams, ^yfa-^^y y KCo^tawt^o ^e^-^ 
JyKtJt«*yJ9-# (WAN) ±-e»»* *6»^lco^tRWt5. . 30 
[ 0 0 3 1 ] 

CPU2, . . . CPUn^fctfSo HJfc I- *5 T , 10, OOOfiKJKO^yea- 

- -r ^ ^ S * t tt S»J , -IH-«±OS ANX^ * 2 0 2S:$trEtt««*y h 
7 - ? (san) Sr^iT^y^a-f^y^^lcgft^tisStof^^ 7 -f * 

* 1 . 7* -f * * 2 , . . . x^^^n(C«#^ix^ 0 ia4SAN^>f yfCMtt, Br 
o c a d e^Jir/Ex c e 1 h IS5c £ *X T 5 0 
[ 0 0 3 2 ] 

^TOa^tra-T^V^gSiHU EUAN (VLAN) \Z ft W\ £ ft Z ~ X & - £X ± <D 
VLAN^^fyf 2 0 4 t^LT, ftI8^^Jl5 0 V L AN^^f 2 0 4 li^f y^- 

*y H 06l:$ttJhtv^ B - « fc , ^^tf^-x^v^S^ii, VLAN^-fyf 
icgiJtifc l o4ti!2o(D^^ hy-^^y^7x-^4:§A,T'^6o f il, 12 
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£, V L AN®®***- yrZ&mLX^Z. ft x If , S9)4VLAN7^ 

V f~ 14 Cisco Systems, Inc*5it/Xtreme Networks^ 
t)A¥^Itfi-efo5«, e^K, S A N Sr*gj£-f- 5 * <0 WtEfiS li^tJ) t) , rHlctt 
77-f^-ft^/M-/ 7 f > SCS It77-f^-f t^/^^v^^^iS, * :/ h 
7-^7^yf K^U-^ (NAS) «S # * 4 *i « . 
[ 0 0 3 3 ] 

mm? u-^ 2 o 6 sANmm&m. cpuaflgjg, *>* *tf v l ANtiflgei: ± 

0 T , SAN^^fyf 2 0 2 , CPU1, CPU2, . . . C PU nfc'il/V L AN7^ 
[ 0 0 3 4] 

*VSFtt, V L A N <D * £• , VLANtSOMltfjiii^y^a-T-f y^f^©!^ 

, tsj:ut3yfa-7^yssffli^i:8iJh,5s a n ± vm m w n 4 ists gs b © * 

^ * y h £ „ SAN±T-flJfflBJ|g/f^. Hz-v'rot^t;' h J S A N y i If V 

v ZjlttSANA- K^iTiaoTlOSAN^-y©- Sffc^ayta- X-fV^ 

A N £ <£ ffl L T , -Aol^ifcliiy K^-lF2Sf&rojgg4fcl±iVK^-1f»vsF 
y y - * I- T * -fe * S © £ Kit 1" 5 „ 
[ 0 0 3 5] 

0314, SAN/-y|rtfett5ill6t|4«t-/<7 7-A©7'D^@T-fc5 0 £ 
&©?:*:/?--/<WSl, W S 2 ft if f4 , IlVLAN (VLAN1) |c±,tP-K/< 
(LB) /77-f 7!)*-^ 3 0 2|;8K^iltV^„ |2VLAN (VLAN2 
) 14, -fy?-*5»M06tB-K/<?y# (LB) /7 7 -(79t-^ 3 0 2 CgM 
# * * gCIJIItSli^ffilltCPUl, C P U 2 ft if SIR 

t5;ii5-C#5„ ^xT-f-^liS AN/-V 3 0 4|:»i^T*5D, i tU4 - X 14 
-«±roiaiSia 3 0 6 a, 3 0 6 bCgiJhtl^. 
[ 0 0 3 6 ] 

fc S B# K *3 T , Wilf@2©CPUl)i^©nyta-7^y^/!) y K Id *5 It 5 n 
>f^-7W>^l?ilfl4, VLANO*^fc±i;f-OVSF|:|git5SAN/-y|l 

»«SftT^5*rrfc*>a. mm. v s f ttmft * «l»n 3 hi r 1 14 ftv^ 

ANO*^, l3j:Dt;Jit ) ©VLAN±©3yfa-7^y^l|'*, VSFSrSffS 

o 

1 0 0 3 7 ] 

VLANro/y^-i/'^^iOtSANy - ><0 t > /< — is y 7 & M'& ~f Z> t \Z £ *) s 

{Bai^iz-yfiayta-f^y^^y y KSr^ftov s f tfti»»t5. locovs 
^ 2/ ^ s c S I y^y^A - K?x744f©xy t v^ 

SAN^>fyf j3±tfSAN^>f h 4 fcli^ V ^ 7 x-^ CftlftCg^ 

^T^4l/^-C, VLANjfcliSANy - y ^ - / SrHSi t 5 : irfiT*^ 

[ 0 0 3 8 ] 

ii ^ > * 7 a: - x ic i o x « fig * ft .5 «r -c fc 5 o CI *l ± «J * nVf^-x^V^y 
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[ 0 0 3 9 ] 

v s F \z *5 5 # n y tr ^ r -r v if m » tt , te^^^f^-r^^^g^ir^^pIlgT 
fe 5 <, fc5VSF(:Biti^^^T>fy^SI, VLAN«itfSAN/-yw» 

[ 0 0 4 0 ] 

- H m m fc & ^ r , ^fa-r^ > if if V y Y tt * flo^Soay^a'-f^ y ^ 3? 

cpucoitip. -t © v s f t*mm prig* * * y fcswfivsFtfcftsifs© 

[ 0 0 4 1 ] 

ft <*> £ ffl £ £ & ft ft ft b ft V* k V* b r. t » ft ^ «> , ^^-/M U y h » # b ti 5 
/S*Sr#5':t*-C#S©-e, # V S F I* £ S ft t # Id 16 * L , lob57^ j/^si 

%<DVtm\zi&h%^tz t # icjg/M- * ^ t » *im t ft * 0 

T K :/ - ^ * tuc x ic ^ < ocpu tiai^I^igiflts: £ r- ti * £ 5 ^ £ a* 
*J |g "C fe 5 ( *t ) o 7>f K/^-yKO$itt, ii ^ <o # IS K » V* X ; #^«VSF^ 
ft £ §f I- T <Y K :/ - * S>J o nyea-f^f y^S*ift5:iist*i^il* 

[ 0 0 4 2 ] 

El 4 A , g4B v 0 4 Cfc J:(;i4 Dli, T^f K/^-/M^ ^ y if x-f y^^l$: 

- > & = *S V -y^ J > if if V y h'O^m* ^ VSF 1 fcitfVS F 2 7^<^©S 
1 *5 <t 2! 2 V S F S*fc t <D b t5, 7^ K;^-;V4 0 Ollfif ©C 
PU4O2*>bjS0, ^(OH^ 1 oUCPUX^^^^WttJilTV^^.o §4 Bi^V^ 30 
T, VSF ltM^ayea-f -f y^S##^Bi:4ofc 0 fi£oT, «W»^u->«. 
g%4 04-e^-TJ:9lc. C P U X £ T >f K^/-/V4 0 0 ^?>VSF l fc: » » £ 5 «, 

[ 0 0 4 3 ] 

B 4 C fc & V* T , V S F 1 \* h \* * C P U X tfi & 5 "C tt ft V* <£> T* . *J » ^ U - V 14 C P u C 

xfcvsFH»f)7>f K;^-;M0 0i:lt. B 4 d *s r . vsF2-eBiJ© = >tr 

a-f>f y^gi^^gi/j:ofc 0 ft o T , »]»/l/-y(iCPUX^7^K/^-/M 
00d»E)VSF2l:8iH5. ftot, R#M#g«LT. F77>f ^(O^l^Utt 
6t> *-0 3yt'a-r^^yi*^7^ K;^-;H:IL (B 4 ) , #£^v s Fj: 
#] r> 3 T b *x ( m 4 B ) , 7^K;^-;M:Un ( H 4 c ) , t lt»]©v s F cut 
5^^:^ft5(Iil4D) 0 40 
[ 0 0 4 4 ] 

rJxb©#a«K*5v>T. fil • y w - y 14 . »I©vsf (ifctt70V^-;H H 

LAN^>f yfJBitfSAN^^yf fe«rtt5. -5HS#n-J;££> # « » <D IB *3 V* 

*©««iSKtf»A*ii5fc. ay^a-f -<y^SJ»ttSAN©B«/-y©*ft8» 
nux, NT, So 1 a r i sfti*) ^SfbWtg^^-^^^trSANi^fStt^-y^ 
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fc9J©VSFOVLAN«^0-St*59J©VLAN©-»ft)ifc6\ i£ 5fc O V S 
FOVLANCIitSCPU, S ANESSt, N A S M & \C T ? ± X T # -5 . 
[ 0 0 4 5 ] 

KH« + «a*o^»*ifcsnfc»a»iiBR»t*^T^s. firtlOa :✓tf a - 

T -f V ^ K * ; *} = 7 T 7 V is a s x-*^-*f--/<ftif<7)# 

SUKBItSa^tfir^-f^^JfiO^-h-fy-tflrJfeitS. K fill S ft tt > 
h -f ^ - ^ttB SrftKi: §§*tttt $ it:* 7 7 <f x-*^-*^-;//^ £ fi fife <o 
it 3. 

[ 0 0 4 6 ] 

«oT, B4A, 04B, H.4 C*5 i WH 4 D |w*5rt 5 C P U XO»ft«t»afl?I-e*>oT 

^-^A^fey^h^aiT^n-KLfcaT-o^w^wfeaiSkSdSrfi^i-So fa n <d ^ > 

^-r>f y^g^t, r> J ^ -y- — ^ r/^-^ 3 yt-/^ 7-^/<-^t- /< 4 if 
(O 4$ £ tf> ® $( * |* * 7s $ ft h X & t> ti X V> ft v> . aye a -f -f y^SJf^aiiij:, ft 

o 

1 0 0 4 7 ] 

RKlOttiltilllilCayii'a-f^^iSj (d -* 4,9*4 ;* t if ) fc«#3*iT 
v> 4 ^ -e . S45VSF«TV-Kiiffifi;#iff , * o fe < j* ft 5 o s *j i u< r zf 

[ 0 0 4 8 ] 

#Sro = >'ta-f^>-/Siii > i^/iVSFi'bfflLAtitSili:, A ft £ ft tl fr 

if-^tLTSlftL, fi. o SU © V S FtC^ih^-frSt, £ i :7* n - 

K '< 7Vt . 7r-rr^*-;Ki;^|;/j:5„ £ , £ ft £ V S F |C *3 <,n T , Linux, 
NT, So 1 a r i s ft f O ^ ft 5 * ^ U - ^ j y {T -> * ^ A £ & j^lft jg ft £ J; Hff 

W^(ift#^i^r*fc«5, tntWoarfeiifcHJtttfirSyttft^. ft o r , a^f^-x 
4 y ■? >f y y h'<D^ffi®&£fc%&mLX. ft ti <D V S F & W k T Z> ft b i>> <0 V - ¥ 
x & & & -T 5 Z. k & X' Z Z> . r Jx K J: •) , #S©f - f ^ JrHfiff 5 # t- tt 5 B 

v s f tfi&m-j-z>*-\?x<omm*fm&*i £v<i«tti**tticx< ft 5. 

[ 0 0 4 9 ] 

fciVST-ot y-frfljffl bit*. ro«*Ht. VLANt^LtfilgiSK 

« s a n tit LxnmmmomtiL-sitfes- >\z&m*K, jfciti»7 p i/-viaot 
y r/w^Y ATSij^p^tuSx-c * * W- => >• f ^ - ^ .< >^s^cD-sWftS^--ii--c^iii 

i ft £ . ^nvfa.-rw >-^H^I4V S F s ft ft a> © & g f- - © & fij^ & ^ r 

. c tii±tif®tfmm ltii:# < wia^iw v s f -9-- ?js ^ w $ n z t m'p-r s . c p. 
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U0>&, * y h V - 9 # «£ tfr 4 * $ J&Sfg* , V S F Tf*Uffl-e* *Btt*HS:it*S* 
5 0Mc , f»-e*At5««B6^. rtu?>^yy-^±Tli. 8#*ib5fctftCPU 
% r ^ Kyu^-zu-CWfl "C* ** y M7 - ^ is J: 9* -f ^ * !> y - ^ fe . 

[ 0 0 5 0 ] 

R^vSFit ^»-eW«^$ixftv^ 0 K/u/-/K0 3yfa-r^ y^Siw^ 
tf-/<7 7-Ai:fiFftt5*S4»«Ettl»ttf»t*^5. *t4t-/<t?-f ^t- 

**©**:/i>->f h©a-1f^o*-br^**tonTL45^rfBtt«:. » if 4 < 4 5 . 10 
[ 0 0 5 1 ] 

[ 0 0 5 2 ] 

isst-^77-Aoi4, ^ni-^r-r^^n-fe^-^^iiAD, ^it/ttt^^/Dty 

20 

0 5 II, UlS^Jlc^^^^^^-x^v^^y^K^.t ^(W^^^ftlo/o * * 12 
■e*>5. I5^#BU KTlc^v^TVS FSrffiSl, * ft K / - K «: ifiJP L , .lo-tti 

[ 0 0 5 3 ] 

12 5 14 , VLAN^r-/^/^^ y 5 0 4|Cgg!^ttfc=iVt 9 ^ — ^A-G^r^tf^V 
lfa-7^y^gS 5 0 2 $:^to VLAN^Of 5 0 4llO*-*y H 0 6C* 
«£*lT*5 9 , loVLAN^-f yftt*-FVl, V 24^S:tttt^o => > tT rt - 
#ArGI4IKSAN^>f yf 5 0 6 t»*Sil, rHttttftOEtfcSSilSfcli^^^^ 
D 1 ~D 5 |Cgg$tiTV>5o SAN^-f 5 0 6(i*-FSK S2ft£f£*rLTl^ 
5 0 $]|/^>8S 5 0 8lt BigK^it/f-^gKCiot, SAN^^yf 5 30 
0 6*5itfVLAN^^yf 5 0 4l:i«»|(lSllTV^ i ©J «l ^ U - V J*. i» — h 

[ 0 0 5 4 ] 

* t: J& tfi V * loVLAN^^ j/ fliffiS^^ *>t V L A N ^ y v'atSlJlt V>5 
0 L J&» L * # * ^d^^-r<i"5/c^ v 05tM-WSAN^5/f ^-<^)VLA 

[ 0 0 5 5 ] 40 

T -f h>^-yH:«!)STbhT^5, VLAN^Y ©4T©*-Hi, ( T << K/u 
V->m) VLAN I i7^^ttlt^5#^(DVLANi:|hSt?)ilTV>5o fiJ ^ 
u-v^VSFSr«dEi-5i5I^B*Six. SANl©B»8li:»DlSh*:ioon- 
K/<7yf/77>TT!)^-;^J;^2oO!)xyt-/^^ift ) (Oit5 0 ft] #P :/ U - 
^ ^ o » * tt , ^g^^^y^-^Sfcllffi^^vt-^-x^v^S^Sr^LTSfi^ix 
5o 

[ 0 0 5 6 ] 

{:Jx(:^i:T, B»/i/-y|j:CPUA^D-K^7yt/7 7^7!>t-/i'HTt§^ 

* 14 ffl 9 S t\ IoCPUBfci:(;CPUC?:!)x/t-/<}: LTllHTSo CPU 50 
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tcpuA#A**5^tt8lllltoi: + d4IIIS#cpuAi:4iE>ii4:itt*t 
5c SAN/-yi{:cpuA4:Eft5:t(:J:^ CPUAit ^osANZ-y© 

[ 0 0 5 7 ] 

d — K '< 7 > if HU £ 7 ^ * + ^< # 2o(D!>x/f LT^CPUBtJil^CP 
UC[cov>T*n5fctf>lc, jH»^i/«yiaotii«Sh5. 7 r -Y T 9 it tt. 
^fy?-*y M 0 6^?>OB*?>li4v^7^t^^?), CPUB*5±t;cPUCJ:«i 10 
t5 0 cpUBfc^CPUCii, 1$£(Ot^u-f >r y^e/^rA («ifi, So i a 

r i S> Linux, NT ft if) jb l J;I/^^f -/^T'H-v'a yy 7 ^ j7 (09 
x. ff A p a c h e) ©fc»©jBBfflOS^^-^S:ttrSAN±©T-f ^^/<-f 
i" IrI & ft £ . VLAN^yftt, V L AN 11:*- h v 1 * i v 2 i SI I, J. 
oVLAN2l:*-hv3, v4 N v 5 , v6:teJ:tfv7fclBili-*J:5fc*rtSft5 D 
IHII^V-yilSAN^'f 0 6 ^|SLt, 77^<-ft*/l'^^yf*-b s 

( 1, s2, s 3io±tfs 8iSAN/-yi|:SEfif5, 

[ 0 0 5 8 ] 

CPU*if©i 5lc»€©f^^ K 9 -Y :/ fc fnj b ft , Io:^^eiit7>{^^f- 

[ 0 0 5 9 ] 

H6tt, tifttvsF l ifftfftSaybra-f-f y^B*on«Kio«*t*t^ 
d y ^ H "C *> 5 . K5>f ^DD l IIBHSID l , D 2 ft ¥ t> MR £ ft Z> 0 12 

6 ^*r»31fl|a&3ftS» f> ft 5 £ , CPU A, B, CfcttfiS&a^^Ktf^jLbft* 
o * ft lc J£ C T , CPUAlilln-K/<7yf/7 7^7n-;^yfa-f^i/ 
S5 * £ * !K loCPUBfcJ;(;cPUCtt!)xyt-/^/ ( i:5 e 
[ 0 0 6 0 ] 

^ % * #t tc m <t < m m <» it ^ tc % »j » ^ u - > # , vsFii^^tsyo^yt-^^ 

i^ii.an- 5 - t # pj|g t & 5 o *>5v*hu v s ; f &m%*tcizwni-z>m.m&m<DV-'< 
tkflf ic x o r ilio L fc fc * -e *> 6 o 

V [ 0 0 6 1 ] 

* n fc «; i: B»^^->iivs f 1 i;cpuD^ii»t5:^ftSt5 fl z <Dtz$> 

Ms f&J tip :/ U - > I* N tf? — h v 8> % itf v 9^VLAN2i:IiDt5Ii-C, VLAN2 
ICC PUD^ril^tSo * , CPUD^)SAN* - F s 4 li S AN / - y 1 CgiJQ J ti 
5 0 CPUDIi, LTiBlfcfcitfllff Six* S AN|B«*«Ofi»PTIB». 

# fait b ft 5 e cpuDiitfcji^^- v^-rt « , * *T ffi if — * * y ^ h if a> e> 

lS5SANl©fttf-^l:R*IBL9ffl7^t^t5. r <D J; ? K , C PUBiiJ.tl/C 40 

P u c » m * tc *t £ t5±5i:, ^-^^7r-A(c^ttbtbfc^zc7'^*tc^«L-r^^t 

t ltttfJ;5n-K/<7>f (CPUA) ^i^t5 B 
[ 0 0 6 2 ] 

fcfcCPUDttjg»£ft % VS F(Ot>fX|j[3o^^x7't-/<^J;i;io^u- K^7 
^f-tcti^LfCo' 0 7 tt. est LTftbJifcHl»tttt4:*LtV^5. 
[ 0 0 6 3 ] 

$!) ®J ;/ u — > # % VSF 2 H^*BtT\ 2oOf)i/f-AJ: lo^o-K/^yfi. 
eSitS9J©VSFtffj«t5SI*S:a«t5t)©tt5. a^yu-yiK PUE^ 
o-K^7y*/77^7!)t«-;uii5J:5«5St, IoCPUFfcJ;t/CPUG{:. 50 
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/8*fcLTOCPUFfeitfCPUGi:o^tSi5fc», CPUESrigfS, 
[ 0 0 6 4 ] 

r®*jfc«:2*J6-*-5fc«K lllP/U-VI4,.VLANll:#-hy 1 Ofcil/v 1 1^^ 
**l (o*9, -f H 0 6C*H). , IoVLAN3C*-hvl2, vl3 

% v 1 4 . vl 5*ith5J:)VLAN^-f^ 5 0 4feimt8 l B « % SAN/ 
-y2lCSAN^-hs 6, s 7 x s 9iJ^ijl5±? SAN^^f 5 0 6 Ji^t5 
0 :OSAN'/-y|t CPUEStd — K/^Vtt LT, SLoCPUF&JitfCPUG 
^SAN/-yiof^^D 2 |c £ *t £ * ^fetJlTfflx^^^^^Sr^ffi-r^^ai 
y*-/<fcLT»fT**5OKfK»4y7b^3:7«r*tflE1I*«S:*A/-ev^5 0 10 
[ 0 0 6 5 J 

0 8 14, t LT» btt SttagSiRtt©^ p y ^ H-efc 5o 2o(OVSF (VSF1. 

VSF2) ^^-(OftlVLAN^^y ^ *5 J: S A N ^ >f S:*tt5^, 2o(OV 
SFI4»I»|:»«ShtVN5 0 CPU 

B, C, D r ^ * ^ r 5 ^ If * tt V S F 1 S: gf * * fc 14 5 & * , VSF1 

<DCPU&£TfXVU~i/\ZT?±XX-ZZ<D&X-hZ 0 r Q i 5 4 a- f tt V S F 2© 

cpuifcii^ M/-^i:7^t^"ej4^ 0 r*u4, i*-*?*^^:^ (vlan 

1) l^glli^V L ANfc J:i;2 0077 ^ 7!)^-/K^|a^t, i 0? 2 V S F ^ 

«^^5S*5S AN/-yofefti:, ioj:9<e7n^^f t.* ^ . 

[ 0 0 6 6 ] 20 

£ ?> . M » ^ u - > , vsFU2o(0?i^t-/M:lt:H^I5i:HI(ft5 

vyKtiotCPUDSr^iry ^>yt5, C P U » is * y V ¥ *> > + Z k , 
\s - V f4 - hv 8 io <£ v 9^VLAN2Jl^6^L, if:IUAN/-y l^bSA 
N?K- h s 4 tSl^to F s 4li7^f K/l^S AN/-y|CEi^5 0 T-TK^S 

AN/-yft, Mx.tf, ( T >T K /V ffl ) S A N / - 1/ I * tz 14 / - V 0 *C Jf £ * ft 5 „ 
[ 0 0 6 7 ] 

F 2{C^«t5^^y^ - '< — l*ttfc±#Lfc9, *5^litt©16i:±5fc»-C 30 

£>5o tSot, SJ #P :/ u - i4 , «8688 0 2-C/7tJ:5i:, CPUDHSF2CE 

it5:^*ft5o * <0 . VLAN3i:*-hv 8l3j:tfv 9*$iJl, J.O 

SAN/-y2l:SAN*- h s 4 fr<£iixZ> £. 0 V L AN * J y <f* «r « J* i" 5 . CPU 

Dli, vsF2ot-/M:!&g/iOSj3j:tf!>i^t-^y7 h^^rojettffl-f^-^ 
&^irx^**§SH2<0iS1£^#K:fflrtfeft5 B £ , CPUDIi, V S F 2 (O Y5. (O $ 

o CPUDIiBt/iS^SASii, VSF 2lifett5ft»/<5 Vv/y^Slifc^x^t- 
^HtiirL, SAN/-y l i:^inf-^*tiiVLAN2i:6^inhfcCP 
u^r*-tr*-?-£rii4&^o cpudu, vsfi w-SPtfcofciDffl©s^t'- 

vsFi©8ii:7n^ti:ittttft^. 40 

[ 0 0 6 8 ] 

SkK, r"©«j«K:*5^T, CPUEICj;oTllffcfix5$^il#(l, CPUD^ttfi 
■CttttfcttH Lfc. ftoT. *JS«fcJ:oT, V S F|di||#ni££Lf4[^^£fa'S^Vfc 0 i= L — 
"7"^ ^^i?ilt^i8^{£{£lSi*"t~£>4 7 i^Sli)6^l^-I^S"t"^S(i&?j^7'l'7^^ /t' SI l& £ jx 
5o 

[ 0 0 6 9 ] 

8S©ft», Ji««ll#-H:l^< S AN^/- = y^|:o^t»fllfc. ftfe^SScos 
AN/-~>^tfflV^;ii:a5 ffilx-tf, LUNU^^SAN/- = >/ i«BL 
, r^^7i/>f^(0^lil:|^v^SAN/-y^^SLttJ:^. lunm^s 

AN/ — ^ > ^ (C ® L fc H 0*J S p°b 14 , EMC CorporationOVolume 50 
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Logics Product~Cfc£ 0 
[ 0 0 7 0 ] 

ft "C % CPUSrSAN±©ttg©JSitfitt5*Sli»o^*)5 , 0 
[ 0 0 7 1 ] 

l o tf> # & TM1 , ^^h°^-x^> ^ g SifcBPftttfeixfcSCS I *T 7 7 ^ 

cs I S-hi^^T'f^-f t*^SANOl94ig^ogKSrft$t5:t(:i»j 

, => ^ f ^ - * ft , D-^/HCSl?HtiniXfcSC S I»SlC7^t^f6 i 5|C7.7^ 
/<-f t*^SAN±©E*Klfc7^t^tM, &oT. jgSb y 7 h !> * T fc if <D V 
7 h!?x7li, p-#^fc*j«»tfetifcscs lM«r^-ht7t5J;5K, SAN 

[ 0 0 7 2 ] 
[ 0 0 7 3 ] 

[ 0 0 7 4 ] 

^ ft ^ £ *> il $1* / - KrTirtD/u- h - x >/ 3 v-efcSk^Srflt^-fS. r tu fl , 
Un i x (Sgfii) '>^7AiW/l,- F7 7^^>7 7A^i|ffc5 0 
[ 0 0 7 5 ] 

<fc o T ^ ft £ 0 OS^m^y - K m V * * x 4 * 9 '< - t 4 *s b ><DVL%.J&9 /Stii. 
*7^t7ipriKt5^7^#7 7^^'>^7AS:fi«t58^, *f 7^^li^« 
«t 5*.^7^^7 7>f/^>^7At LT^SSii5 0 f^«lc. x v/^^^ii, ft*^** 

[ 0 0 7 6 ] 

:©J:5 4*f 7^t^is^piJ6-eib5t^i/-7-f v/i/^rA©S^, o s *3 J: IB 
i7/y^-i/ 3 y^te^)/-Ki:#tt57^^ llirfflti ftv^fcft, -f 

^^^S^^r^^^K^mLllfflT^-fer^i-tltfJz^o Un i x (S® 

[ 0 0 7 7 ] 

B5fc§liiLT±EfcRfflLfc*j*li % W© V L A N^^f y f tr«E*«LT*t ijt 
»VLANftilSrifi£t5r il:J:5, Io#ft«)S AN^-f ^fcttI»«Lt**4 
S!»SANyr> a tlitt5:ti:J:D, n y t ^ -7 ^ y J: l5|2gy - K 

t£ 36 5 ~ £ ^ T £ 5 0 C <DWi£ , aytfa - 7-f 7 Fit SAN/VLAN 
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X.»^y*/ a #CPU*3J:tfEft8lo#Si:*ft©#-ht«trii:tRv^T, @5l: 

^;/g*HU ftTtHflt 5 <t 9 Id, VLAN/SAN^yf©Oj(#-H:ftlft|: 
S« "FtS"?* 5 0 #*©VLANX-< SrtSIttHL Tl«/^Srtf - * * y h !7 — 
9 4 w fc tt, :O^Sl:^^tfeUT^5 0 09 X , G . Hav i l and 

Designing High — Performance Campus In 
tranets with Multilayer Switching (^H!)|x. 
*tt SiUttiSilf f*J-f >- h 9 * 5> h ORft) " Cisco Systems, Inc 
. , »il)«B r o c a d e i»b AfWtftftfc* «T+ 5 r fc . 
[ 0 0 7 8 ] 10 
S ANT~*x * 

c s i»7 7 ^ y y *^ft ^<*> ^ 7 ^ ^ ^ ^ywzc > ^tas fc a> e>«fi£ $ ■ 

y ^ <C if © K d» O ft « , 4fctti©«iil^p Fa^S:ttfflt5^^yf SrttfflLTiflt 
SHTU^o tC> I PiTSCS I/d f3/^i}T^5:i:ia*), I P * y h 

v - * ±v s an zmrnv z o t\t* om.fr&ftftt>ihx z>o ± u fc # it # / 

X^-yte, :hb©|OSANi**ftKll5tt5. VLANpIll2Sit'I P± 
-cscs I tiW-fu h3;^IjT$t5:H:iot SAN^«it58^, SAN/ 
-y|Utlf,^145VLANi:v^t'y^t5:HaoT4^Jn5o 20 
[ 0 0 7 9 ] 

OLANfi«J:-C»^t5*l/ H7-^7^yfKx (NAS) $: ffl L T t> J: 

4: SB {fc -f 5 fc * SAN/-y©ftbDi:fti5VLANirttfflt5. I ^ i; 5 4 N A 
S « §& te ii , SuntDNSF^o F^;^Mi c r o s o f t O S MB ft if y b 7 

[ 0 0 8 0 ] 

mot? is- ><d£m 30 

rcfc^^Jr^fc, »] » ^ u - v tt , SANfciWLAN^^ ^©WlPfcJ; rJr - 

b \z&m$tiz-'Xt±-&LJi<Dmm}) y - * t itstitti^. tn * ft ^ 

t>©"Cttftt\ W»:/i'-:'lll6«>«*ftffiS:, HT©Sl) ^J^^U-VT-^-r^^ (,. 
2) ^**-1r>/^ v 3) flfitt, 4) *tH3j:tf«^KH-r 

[ 0 0 8 1 ] 

J§ fi - « fc , -xiiiK±o^i/-/t^^y h-e^^ + -«ii:ifi8aSiirche) 40 

5 0 -XlirKi^77-A-7^i?^-tt, -XttIBiOVSF*flt5. -r ;* * - 
fcit/^u-yt/^y hv^^t-iili, ^-K>*7B», =■ >- tr a. - * V y h 9 

[ 0 0 8 2 ] 

B9tt, -%1&Vt\z i. zfflffl? \s—>> 9 0 2*5 t tt/3 3 vt-^-7 i ^Vi/^iJ y K 9 0 4 fc 
or^^lHI^^t^D y^|2 9 0 0 t**)5 0 Siai/iz-yQ 0 2(1, ay^a-f^f 

y^7^-^«r^LT, □ y fa - f ^ y ^ / y y K 9 0 4 CtSixS ^t^-r ^ y 50 
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K 9 0 4 fi, ±aufcjJ*fl|:J:94«jnfc*ftoVSF 9 0 6 *fcfi»i!l y-^^r 
[ 0 0 8 3 ] 

— UttGJfcJ:**, Bi/u-y 9 0 2 liv^^-t^ / y ^^v?t- 9 0 8 , - 3U1 

-9i2£<g-A/-ci^5 e #-t ^> y - 9 0 8 , ^ i/-^t^^ y )>v^ 

1 0&£T*77— J*-?*i/^-9 1 2 II x n y h'a - f y ^^7 7 |^ 7 

AiT^fi^tt iv^o flESi, *-(0-7X^-ti/>yh-7^^t-9 0 8 0^§:@ 10 
f 0 0 8 4 J 

■7^^-t^^y hv^^t-g 0 8 fl , ^u-y-ir^^^h^^v^-y-9 1 0 ii ffi 8S 

mzti* riisrasteitfffiLtv^, ^^i^-yt^^y K^^t-9 1 on, — 

ixtf . #7 7 ^-y - 9 1 2 li. StbfcStJC-f -5 * U-^-fc ? * > b -7* 

>?^-9 1 OKTI-^nyfa-r^y^/yy h 7 t-A J:(Oll~fiII:E| Jix 
5 e 77"A-7^i;t-9.1 2li, ^yifa- f -fV^^Jjf K 9 0 4 1-CVSF906 

SrStft, i^fc<tr;i^t5o J:ixH\ «-7r-A^^>?-y- 9 l 2fifit 

5I-OVSF 9 0 6 iS«9at5>h5i5, 7r-A-e^i^^-9 1 2t^(DVS'F9 20 

0 6^UD StbHSo 7r-*^*^*-9 12tt*iX^ftii»Ttt:ft<, &*U-zT 
±^^>b^^iy-r-9 1 0£:frLT<D^ii{i£fT9 o *V--? r i?? r p<>' h ~* * i? * - 9 

1 O 11, 93t?)Jifc77 i -A^*^t ta -9 1 2 W)Ri4:gffit5 6 * u-^-fe^ 
^^*^t-9 1 0 II. mm»±*milt»T Ltt*tl*tlto9 %X T-**r 
*i?-r - 9 1 2^SlJit§ 0 

[ 0 0 8 5 ] 

vx^t^^yF7^^t- 9 0 8 fivsF 9 0 6 ©B-7-fy?tslSLr, & v s 
F 9 0 6i:»!)aT5!)y»^(DiS:ft6t5. v^^-t ^ / y - 9 0 811 

, ^H*^i:t77-A-7^^ + -9 1 2Sr^tTVSF^)y y-X^|| t^it^SI 
DSTWitSi il^^-yt^^y hv^i?t-9 1 Olci^f5o 07 / !) 4r 30 

y©^g*tt(:j£:i:ri^4AS^7yi/y^7;^!) XA^^utt J;< > B. 

[ 0 0 8 6 ] 

•7^^-t^^y Fv^i/t-9 o 8it y ^7^yt-9 i o 1 y 

-TVi/<t^^S^LT, =J>-e^-x^V^^y y K 9 0 4 11 3 SO f- - tT * $ jx T V> 5 
5 S: $J Wr 1" 5 • v^^-t^^ybv^^t-DOSli^u-yt^^yhv^i/t 
-9 i o <omv %x&£x*®v %xM&*'n^s ^Si:^ct=>y^a-7^y^^!)7 

K 9 0 4 ^agJCf It5f:*C7 7"Av^v ? t-9 1 2<D§4 9ST:fcltJ ? #] , 9^-Cfl? 
I»*:1t5 i5^^-/t^^y h-7*^t-9 l 0 £ Jg -f 6 o - 36 i£ <fc *Wl . ^ ^ 40 
^-■fe^^y hv^v^t"? 0 8 t % ^ll:^CT77"Av^v?t-9 l 2ioJ:(;^i/ 

- 9 1 2 — £0 VSFWll^t, fcJ:tf^l/-yt^^yh7^v?t-9 1 0^(0 7 7- 
A7*i;ir-9l2©|l!)STt:fit5. - H IB 0» £ ft , xu-7*?*>b'** 
^ + -9 l oil7^^-t^^y h-e*i;ir-9 o 8ig«i:lSi, ^vf^-r^v- 
^^!l7 K 9 0 4 ^©tIS*, *3«tt/8i]<O^U-/-fe^^>h^^v? + -9.i o & 1 

/if:li77-^^yt-9 i 2 (Dm^Zft ? o -xii-Klo^v-^t^^y^ 

* v> - 9 1 0^J;tjf-^lir«±^7 7-A'7^^t - 9 1 2«rHfirLT^5^l7 p 7 
y h y * - A # m IB L ft < ft o fc & £ , ^^?-t^^y hv*$?t- 9 0 8lt, Jt L 
f:3yt'a-r^y^/75/ F7t-A«7r-A7^^"9 1 2^bft^77-A-7 50 
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^^t""912^VSF 9 0 6 iBl!)STt^ ^(DiBSs ^ * 9 - / V h ^ * i? 
* - 9 0 8 t * VSF 9 0 6 ©ffH9STtfTHftl:9l©77-A^*^t-9 1 2 J- 
^^1-5<t5tw^U-^-fe^^>h^^v?^-9 1 0i:)g/Tt5:Hitt5 o VSF9 
0 6l:f»)ST?)tif:^S[W3y t'a-f^^y y-^, Zr'&nT 9 7 4 7 ftV r ~ & 

* v? * - 9 1 2 , iD^t/^u-^^^^vh^^^-v-gio^r^x-r^icIf a.-r £ 

-±i/^yh-7^v?^-9 0 8li, T ? T << 7 ft X Is — 7 ± ? * > h is *c — 9 1 0* 
fe(l77 - A * 5? -t — 9 1 2^tlt^4V^>^a-f>fy^7'7 7 F7t^ A £ 

tyhy^Ltttv\ Bm\*s ft 3 ^ V*. -7- 4 s?>f V v K 9 0 4 *5 £ VM'M 

7'1/-V 9 0 2 flii)i6 0 10 
[ 0 0 8 7 ] 

-CXU-yt^yy h-7^^t-9 1 0?:flt5o ^Ottffi. « 9 ST 

btlf:77-A7^^-9 1 2, i3j;i;Si]i9STf)ix/cVS F 9 0 6 4^©Sft^)^^ 

1 0*«9Stl3J:ijt|l9at)!fR*iiSi, w ^ * h !> tt JE£r * ti T , 
:/i?^vh-7*v^-9 1 0<o*IEASK8*Stta D mati. ftL^x ? * > Y 

1 0#-r**-i?^p< y h * -y - 9 0 8fcJ:^SI9 ST<b*ifc--Xtt:z 
HiOVSF 9 0 6iaoT«l*ftJn5i, U^^hy^J£gf$ttT,ffbV^^-^ 

-fe^*:/h^*i*-Y-9 1 0*5J:^-5:<oSiJ0^Tbixfc7T-A^^^^-9 1 2ivs 20 
F 9 0 6 ^tfilc^5^Jti5o & I- , 7^?-t^>>h-r*?t- 9 0 8lil/*^ HI 
Sr^JHWfcW^T* ^u-y-fe^^Vh-e^^^-9 l 0^if©i5i:vSF 9 0 6 £ #J 
9 3 T 5 © # <fc n m ir Z> z. t & X § 5 o 

[ 0 0 8 8 ] 

- * ffi « J: ti tf * FDli, v^^-t^^y h-7*s?t-9 1 o#r^t^-C* 
5-7^^-t^^F7^^t- 9 0 8|:o^rottS^tA/t't^ 0 « x. H\ I* V * V 

Sr-&A/-e v^T fc J; v^tox*, frlv^u-^t^^y hT*v?t-9 1 0 3 ix a i , 

frL^*u-:/1?^;rf:/h-7*v?'Y-9 1 Olii/v?^ FUfxynt, -xriiai 
a>^**--fe^ y h * -r - 9 0 8 <omm fco^rtttt-r 5 :i^-cts Q 30 

[ 0 0 8 9 ] 

u * h y li , aS^iz-y 9 0 20^(:ft#Jni< TtJ: 

V^o l/i^^ hyflayea-f-f y'K 9 0 4 OE*8II-ftffSfttt 

iv> 0 z<Dmx~\*. mmmwi*m®yi'-y 9 0 2i$m ttev . vsf.9 06ic«ds-c 

[ 0 0 9 0 ] 

- jR (c , ^*#--fe^>:/h^* SJW^u-vjftsaScSttfcit, *> 5 I* tt K 40 
-y#Lxm-<D-r x9—-k ft > Y-r 2 o jgJl ± co -7 x * - -fe ^ 

i- 5 15 5 ##*J4»^ t fe 5 a 

[ 0 0 9 1 ] 

y co -7 ^ ^-ir^^vh^^i/^-SrJiai-t-So ^ x 9 — ± if * > Y * *J * — 

- y -fe ^ / > h-?*i? J r-&-*x?-'t?'J y — i 4 0* & g Jfc £ T B« 0) * 
u-^t^y^^^-iKOS'TS. 2oj£ji±(7>^u-yir^^>'h^^v ? -y-^5 50 
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[ 0 0 9 2 ] 

J: *i if . w v> * * . fr^-^t^^^^^-iciotaaftcn^ij^ 

[ 0 0 9 3 ] 

^^tSrl^-7^^-t^^yM^i;^-^ft^t5o Mz-tt, * t> v> fe -5 ^ tit ft fc 

[ 0 0 9 4 ] 

l^-SJffli^U'-vox u-^-ti/^ > h -7 * is v - ft , §ft(07X^-t^^ v h * it 
*r -\c=* > ? ? h ( t° > ^ ) t^^ia^^^t^^hv^^t-^^i^SM 

gi£<D-7X*-i?^;rf y h ^ * -r - ^ r * T << 7 V ft V* i: *| »r t tz « & . SLvw^^ 

[ 0 0 9 5 ] 

Ell Ofl, *JBCftJJCJ:5^^^--fe^^ Xh^*^ + -lfflottllBi 0 0 o^^Lt^ 

. ^^1 004tft5 o ttil 0 0 4l:*J^t, ^U-^ir>/^^h-7^v?^-(i % 

* > h ^ * is * - (D * << J± x ? y y> (ts) # JE *r £ Jx 3 . v^^^-ir^^ y hv^i/t 

i i o o 2 ci5 9 ^ ^ ^ m t ^ ^ ^ - ^ ^ ^ ^ h ^ * ^ ^ - e> « ^ ft ti tf , # 

11 o o 6i:/^ 9 

[ 0 0 9 6 ] 

ftfii o o 6i:*j^t, 7^T^//jj7u-/t^^yF-7^.i;t-(oy^h^||t, # 
tt'l 0 0 8|:4S 0 ttil 0 0 8l:*5V>t, te^^u-^irj/^^h^^v^-y-t^^^ 

e>^5 0 ^***--fe^*:/l*-e*$?-* — ^7^ f H:^ i^- 7 ± V ^ y Y -7 

* i? — » m M t ft 1-ftfc>*>-xti;-j£*±o* u - ;/ i? >/ ^ > h-e^^^-^w^^ 
--fe ^ y y M^^t-^ i!l$tf>JSg .SrSrfS L -r^-ir^Vh^* 

^ * v Y * -t^^tEO)-* * $ — * Jf * y Y * ^ - ^ ?> S i$ (D ft g £ § (g t ft d» 

TftV^t«ISStl, ttffil 0 1 Ofciifr. 
[ 0 0 9 7 ] 

ttll 0 1 0|:te^t, x*mi£LtzX ? ^ y Y^*i?*-t±mmT-7 
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-&&&<Dmto&^<og[ ^fc^is-ir > x&^zm*tii-rvim 1 o 1 2\-mu 0 vtmi o 

l 4l:^^t x # £ tf> ;* u - y i? ^ > > h * i> ^ - *s g t {g;v> - ^ v * § £ fl* L T 
5* 5 5. *T LTV>ft ^©3^ ftil0.02CB5. Sltt^S^, 

[ 0 0 9 8] 

* y h * ^ * - li fc: , -t ^Sd 13 S T b titz V S F tf) 

•t - tr * i , ^^^-t^^ v h-7^^t-/5^o#^l:SCt©Srtiv s F to W ^ 

[ 0 0 9 9] 

01 l 12. Slfcfllz ± 5 * y-fe ^ ^ b 3?* - <D«* 4ttlS4r^"t-ttji0 i io 

fig 1 1 0 2^b, S«E©T^^-t^^ y h^^^t-0««i:»Bt5 5*l:«i:T, 
# <8 l l 0 4 it t*. # IS 1 i 0 4 -Cli, ^ i/-yt/^ y hv^^t-liia^-r^^ 

d» fe ft tf , ffi l i o 6 |:Itf 0 *t 18 l i o 6 r tt . <fc<D*u-:/ir^>h^*^* 

ztobitZo wmi i o 6 t>h , mtevtm i 1 o 2i:i6 0 

[0100] 

ttll 1 04-C. *#*ft»J*ltf, ftffi 1 1 0 8 ^iifc> 0 tttt 1 1 0 8 T 

v^l^f Li^ofcr tSrtn5>t5 0 ftlc, Hifttttt l 102CI5 

0 ft 3Mc x + #ft&<o*i/-:/ir^^h^*^i'-#m 

^ * - JtS & £ £ ft L ft o # £ % lU^^J'-t/^ v h^*v** — Sr±lB0>,fc 
[0101] 

«Il 1 0 2^f) x -7^^-*^^ ^ h^*y-y-^&VSFSrff|lt5S#tgfllfc 30 
b % tt«g l l i o lcitfr e i l i o VSFiiffSJht, BStetttS l l 0 2 1: 

[0102] 

± i£ L J: 5 K , * # — - * ? * * Y * i? * - , -fe^^h^*^* ( 

-^Bflti^yf ^-f^ > ? V V y K^VS F^-xiil^l^)^ i/-/t^^> h 

■r^i;t-IUoTl§J(:f-if^^ii5J:?l:t5o r © fc ft ic , -7^^-t^> y h 
^ * ^ * — , -r x — t ? * >- b * v> - i: LXtDm-ffl'M^is-XD^LXO)* u - 
y-fer V h ^*S* + -©£fflttlft**fT 9o -jlttflfc J:ft«* vx^^t^^yhv 
*?ir- 9 0 8tt, 1 0 ^ P,«I)f i^M«)i:?*t 

6 o t* $R I* #J X. If . ^^VSF906 ^5^u-y^i/^>h'V^v 7 -V--910i:<toT^ 40 

- f * $ jx t'V> 5 d» £ ^ A/ -e ^ 5 . ^£(07i^-yt^^y 1 O^tJ^f 
ffl -K ^ L ft ft ft , r^^-t^y y hv*v?t- 9 0 8tt#^©^u-^t^yy 
h ^ * *J -t - 9 1 0 <nnm * ¥ffe<DXls-7±?*>h-?*iS*~9 1 0 £ S §i§ 

* * — 9 l Od^SiJeo^i^-y-fe^^^h-^^^^-g 1 oi:7r-A-7^^t-9 

1 2^BIIDStt5 0 fcfc. «r 7s $ -± ? / > h * ^ ^ - 9 o 8 ii-xiiIBi«)« 
©^u-^t^^y h-7*^ir-9 l o^W/TftLT, /Pt^o-r^y?©S^7y 
^yy^$rff 5:H5fi5o -JlifcWfcifttf, v^^-t^^y h-7^^t-9 o 8ii 
, ^u-^-t^^y F-r*^t-9 l OiJIfTLTV^ayta-f-f y^^?y 

- j±<Di£mz^mi- 5 . ^yfa-f ^ y^/7 5/ h ^^-Ai^g^fena, ^ ^ - 50 
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■fe if / y h^^v?^-9 0 8 , IgWfci^f^r^^^y F>t-Ai©7 

[0103] 

0 1 2 li, 2 o o-cfc^. & g , ;* * - ir 

i/y>- h^*^ir-Mtt*tffil-2 0 2fc*5V*TH)*&-t-*o *t ffi 1 2 0 2 b , -7 * * - ir 
9 0 8 ^811 9 0 2(07U»/-t^^y^^i;t-9 1 0 tf> Ji Jfi 
W^^SrtT9^fc5V^llr^*g*Lfci:tlc. *t IB 1 2 0 4 Id if 0 flt » l 2 0 4 4»5> 
% ±T*>*u-^-fc^>^h^*^*-9 1 0#fJ|UJ;5t«*Lk8^, fttB 1 2 
o 2CI5, wttli, ± r <d ;* u — ^t^^y i o^, £r<o*u-:/i? io 

^ h ^-r - 9-0 8 Lfc»*»c, ti:5o -XttrKi©* ix-y-fe ^ v 

[01 04] 

# m 1 2 0 6 *5 V* T , -r^^-t^>yh-7^^t- 9 0 8|j:iSOifeof:^l/-yt 
U-^t^>y hv^^t-9 1 O^HBB^yir-v^^^^r^^T^^o ffi 1 206 

a> b , £roxu~:/i?^:/h^*v^--9 i otf^fiLfciifcuS*. 1-ft tofeHH 20 

ft < & M ZtltcWi&, ttffi 1 2 0 2 15. #J X. , ^^fcofc^U-:/^^:/^* 
v> - 9 l oasHHft<SM-t-5i:. *u-:/-fe* r *vh-r*S> + -g 1 0 -7 * - i? 
^^vh^^v>^-908 ^SIB5i^y^-fe--^^^5 o «(Ml 2 0 6**6, - X \* ~ 
±©^U-^^^^Vh^^^^-^ffBB T tft^ofc#^, ttffi 1 2 0 8 (Cittf . wft 
I* . * * — -fe ^ ^ V h-^*v>^-9 0 8 ^5#^0^^-^^^^Vh-7^v?^-9 1 0 

[0105] 

ftll 2 0 8l:io^T, ^^^-t^^yM^^- 9 0 8tt, * U- — :/ ir h -e 

* i< - 9 1 O^llffi-^-rv'^^mffi^P-x^V^^ft^i-So 

^ * * - 9 0 8 ©o-f-f V^HftSrftSfcftt, 7;^t^^F7^^- 9 0 30 
8lt ^^^^^^^vh^^^-v-gioSriS^^-y^^-t-^^, fc^VMiWttff 
-^^-^9 1 4 4JfSiJiDiM^bP-7^ y/i«*S5c * # W tt , ^ * * - -fc ^ 
V h-7*^t- 9 0 8 *5^u-^t^^ y hv^^t"9 1 0<an-r^:/^ffi$g£#<5 

[0106] 

ft ic Ifc ft i 2 i o«cii^, S^ofcofc^ u-yt^^ y hv*^t-9 i o « t> 3 x 

btlfcVSF 9 0 6 iffiW^U- ^t^>y h-7^^t-9 1 OlCffflOSttSo VS 
F90 6 iSfl|9gxe>^^TV^5^U»-^"fe^^V^^*^•y-9 1 0 1*. ^OSSI^T 
i5^T Lfc©^Srv7^-t^^ y h-7*^t- 9 0 8 I3bt5c Miff, x 
?*>Y^*\?*r — 9 l0ll-7X?-t^^ y h*7*^-r- 9 0 8i:Bfl9aTltB>y 40 
i? - 4: & o X , VSF 9 0 6 ©ff»93TisUIIi<«fTLt:iS:S6t5:t#-e 
£ 3 o M 3? tf> *> o fc^u-y-k^^^h-^^v?^— 9 1 0l:Rlt54T©VSF906 
©S«5St#j»BJh5St, ttffi i 2 i 0i:fii5 o »» * ixixtf , tttt l 202c 

[0107] 

S^t^*)o^:^l/-y^i/^^h-v^^-v-9 1 OlcHatS VS F 9 0 6 S:tt©7^f 

N^^ir- 9 0 8li»J(O7l/-yt^^yF7^^t-9 1 0 £ #J "9 3 X , SL^^I/ 
-^-fe:>r^Vh^^v?^-9 1 0l::tlb«VSF 9 0 6«:»0SXXt>J:V^ K # tf> * 
iz-y-lr^^ y hv^^t - 9 1 OSfclitrLl^^U-^ir^^Vh^^v^^ - 9 1 0 ^ 50 
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VSF 9 0 6 Zmm V %T-f Zfr ¥ ? fr<DmiJil*s. '> ft < 4: fctt£«>fc % ~£r L ^ * u - ;/ 
± V * is 9 l o oftl 9 3tl:iiit5^*)^K, ^ittgEffo^u—:/-^ 

^ > h-r^v^-9 1 0 ^ tf) V S F 9 0 6 <Dj$my S TCllt ^^^^^Cft 5 C fpj tt 

ftix<B#feKt>l8££ft5r£ttft^ 0 

[0108] 

3 . tgmmm 

tlTV^ 6 Sliffi9 0 2li, ^D-/<;U^y y Kv^^t-|;, R& % o - 

f^^.Sitffcoa^a-f^^yyKMtiftti. Si 3 fi N glfcfllK: 10 

[0109] 

SI 3|C*5V>T, 3Vlfa-T^^9s'Fl 3 0 0tt > ^9yKt/^yM302 
ifftfft5S£3!gfl /^r^> 3 y^5 0 #^ y Ft^^H 3 0 2li, 9* - * 

:/ u - 9 o 4Sr»j»*5ii/ffa-r5«iai7 p u-^9 o 2 ttAz-ev^s, r « k ** t 

, ^f-^^u-y 9 0 4iii9^3yfa-f>f y^^y y K 9 0 4 ilS-ffc^d^ 

3 0 2 trf St5^B-/</P^y y K-7*?t-0*»tB«t5*;ft, r ^ - * y u - 1 

> j & up tf n 5 a 

[0110] 20 

Kt^>ym, ^n-^/^yyKv^v?t-i 3 0 41: i§ m ft tt S'tt * « ^ 

D-/<^/!)y 3 0 4 , ffl » :/ U — V 9 0 2 , teXXf^^K:^— y^J 1/ 7 

5v^tt*Jtoaytr a -f ^y^^9y h7*-A±-e»»S*Tt)J:<, * » W Ii 4* £ 
©*«*ftfcH£*ftSwittftv*. 
[0111] 

^ p _ ^ /V , ^ y y K ^ * ^ ir - 1 3 0 4 11. 5/ K * if * ^ b 1 3 0 2 »Itf 

■CffifflJti5ffl»^i/-y9 0 2d^o»4, n - x -y > ^ , &J:tfte<Dlf$&£fttf>5r 

i^tti. ftl X. tf . S4M*S«LT, ayta-f^y^^Jy K 9 0 4 A5i«t 30 
[0112] 

4. *ff*5J:r;ftilco^tw%S 

y^^J y Ki:*lt5Bit5VSFia«pn|-(?ftitlxttftbftv^ la «R ic: ^ 
a-r^y^^y y Kl:i3(t^vsFli, f (Dlit5xi^-^t^^ y hv^-yt-i 
ii m ffi "C ft ft ti tf 4 S> ft 1* o IE C ay^a-f^y^^y y Ki:fcit5VSFtt, & 

5VSF*fiM»OJSTft©VSF©t((St«iTLi jOtrlSCftftl:, S VM^ a « 

«r IB "x? *> o x 11 ft ft v> o zftb<Djf&&nMi-&&*b&miz<>^xi&mi-6. 

[0113] 40 

@i 4 11. x z> =* > v << > w v y K^sijffli^u-vsrft^-r-sr-^T 1 

4 0 0 T' £> £ 0 # fiB # * 1 4 0 2 T-££fcT!a£iJ£ft5VLAN* 
(VLAN SW1-VLAN SWn) ^ J: (/#Sf f 1 4 0 4 t S t i!) t SS'J 
Jtl^S AN^^ yf (SAN SW1-SAN SWn) <D f|ij $1 ( TCTLj ) # — h 
Ii, (Sftffifli) H 4 0 6 CMSii5, * - * * * h (g^iS 

at) f^*rH 4 0 6ii, 4 0 St* ifetasjsnssaw^yf a-f 

^y^ll (CPU1, CPU2-CPUn) IC Jggg £ ft £ 0 o T , Mfl^U-y 1 4 
08©^t'a-r^y^SIW^^, VLAN^>fyf 1 4 0 2 »itfSAN^>fyf 
1 4 0 4(OHi^-F (CTL) ^a«»«$*L5 D COflJJStt. VSF (H^-fri*) t 

^tt^^vtfoL-T 1 ^^^^^^^ *nB#ifcliiovsFf:|IIt5VLAN*iJ:(; 50 
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li r * n 7 ^ # - h t- fe 5 * t & ffl pj ffi -e fe a o r <d m & s ^-Fttaii/^ 

[01 14] 

015 11, mmmt z zffl&7 r i'-> >v << y^mm (cp c p u 1 , cp 

'CPU2-CP CPUn) 1 5 0 2 Jrf-^ * - Mcglt 5«ig**t^ o 5. ^ @ l 

5 0 0 T*fe3 o w <r> m $ fc # ^ r % Miyu-y^yea-f ^ y?g$s o 2ii, ©j #p 
/i/-yayfa-7^^Hi 5 0 2(7)fc^l-Ibf^-t-6©J^yu - ^3: - yx> Fl 
5 0 4 l£ $ ft ^ * h £ 21 5 0 Sli/u-yi-^xyM 5 0 4li, y 7;^>fA 

f-^^fc^i^yt^-f^ y^^*5 0 2^iiwi^-!i y^ir, f - ? turn 10 

yU-Vrr f ^ _ 7^ > ^ g H 1 5 0 2 K j£ 5 e »J #P 7" U- - V 1 5 0 2 K 5 & 1? ;/ 

pi^h^*^*-!!, ©J^^U-V (CP) LAN1 506lcaflrft«Sftr^5. CP 
LAN 1 5 0 611, CP770!)t-;H 5 0 8 ^^LT, VLAN^^j/f 504 

4 y 1 5 0 2 \cftm^mtefe&ti:^m&*z.bti. ^y^ 3 .-r^y^H502 

[0115] 

01 6 Jl , mmm^ £ Z> > t° ~ -"r J > ? ? V y K^ai/l/-y^8^t57-^rf 
^^^0^ 1 1 6 0 0-Cibi, SIJ»7 P U-^1 6 0 2I1, SJjffliyu-^nyb"^- 

r^y^^lcp cpu 1, cp cpu 2 — cp cpun^^fi^o 20 
»yi 6 0 2l:*5it5&9Jffli^^^>'^>'k B ^-r>f y/^icp C P U 1 , CP C 

PU2-CP CPUn ft, iftt'SAN^r>al 6 0 4 «:«lSt S ISdO S A N ^ 
J/f03K-hSl, S 2-S n l^lflgi^tl^o 
[0116] 

5 A N * y > a. 1 6 0 4 fl , y — > 1 6 0 2I^Lt/7^f^- K'fc^T-^ 
^tfEISJSIIl 6 0 6lc»fiS«$nsS AN* - h S o, S pir§A/-C^So IE-It 36 K 

1 60 6*1, ffill±* 7^f^^ t lt@l 6|C^^tV^o GttgK 1 6 0 611, V*-f 
tL<7)^^7 P ^i5lt^frT*llffi^^Tt 3 <t<. *J8flliE«*il 6 0 6 ©»)|©1S<0E 

• ttfrteRjfeSfisrfcttfcv*. eiHlIi 6 0 6ii t mm-fis-y^y J s<- h&IMS 

-VI 608tC^SWlwlBS^tL5o $)»yU'->'7 P 7>f^-hEi/->l 6 0 8 II , 30 

SAN*~hSo, Spll$!l^l7 P l/->'^y-r-<-HSti^-^^ ,J £-<0 

6 # T* fc , ftwsAN/-y|: (IE tsnsr itt4v^fcft, sa/i^-yi 6 o 2l: 
*lt5 3^^a-f -fV^B*©*.tfEII81ll 6 0 6 tr^t^-C*5. SI, 
S2-Sn, s oftitfs.ptt, Bi^u-y i 6 o 2 ic^ft^^y t 4 a-f>f y^Si 
^ii«gg«Six5«>*«)fiiai^U-VSANy-V*C#iE+5 0 :ilf)<D^- Ml, vs 

[0117] 

-*tS0J£J:iifi* »£©3yifa-f -f y^ssicp cpui, CP CPU2-C 

p c p u n#fc9.mm*lt&% <d-&\zt * ± x + z&&tfhz>m&* * ft II # £ tf> v 40 

s fo-St*0, #£<z>=i>fc'^--rw >^g§ifil#£tf>vs F©SAN/-y.rti:i 

^ll^o Witf, 3yt*a-7>f y^SICP CPU2*VSF i ^ >f * * 1 6 1 Old 
7^t^t5«S#fcSt©tt5. r o 3§ £ , fflftp^u-vcp CPU 2i:lit5 
*-hs2ll,/K-hSi £ ^ tfVS F i o S A N / - y |:Ef J ii5 D — 1£ = > tT ^ — 
r^y^SICP CPU2^^-FS iOVSF i x -< * * 1 6 1 0 ^ T * ir 5 fc 
, ^^t'^-^^^^^^CP CPU2HVSF i OSAN/-y^f)S!)i^jl5o 
[01 18] 

H0*§nc, ^ y v =>.-7- << y tf^m c v c p u i ^ v s f j x ^ ^ ^ i 6 i 2 i;: 7 ? -fe * 
ts^S^feitoits, z<om&. ^yv^-Tjyfmmcp cpuiuvsf 
j »:Hit5SANy-yrti:EiJfii5. ^ tf> & #-FSltt, # - h S j S: $ tr 50 
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rmmc P CPUHiiK-hS j l:gg$ilfcVSF jf^^l612^7^t^f 
Z> k . => > £ <( > C P CPU l.liVSF j l;|ilt5SAN/-yi5^|| 

£ £ ft 5 „ ro^SlCiD, E&ftSAN/-y0J#]£&fflLTyy-*^C!>7*-tr;*£ 
]ESS»c$J^i-f5it«cJ:5, DS/iz-ya^fa-f ^y^I^*±Dta^iyi / -^g 
i/-yi 6 0 8 o^4itj!#t>li5. 

I 0 1 1 9 J 

± i£ L J: 5 IE , m-o^Jffliyu-ynyf^-x^ y/s$a§t©v s f (Vgm&n 
5lt^-et5. «goT, ^-oftJSPzT'u-^zi ^rn^ii. ^{H^iyu- 

^IE* L T» & £ ft fc#$t#IBiJ|;:& o T V S F W <0 7 r ■< T V * - A> £ Hff t ft tfi f> „ # 
8© V S F fcisit S i #trNl»£naic-C# ftltft-tf * ftt*. #«■«»]«:, #«y»^u 

(09) K « # , *>4V»tt1"jfet^>yhT*5?t-1302 

(HisJicio-cmfcL-cbJ:^. 

[ 0 1 2 0 J 

-*ffi09lEj:ft,tf, (ftltt^^f ) jK-h(CS-^<VLAN;?^|4^7'-7-C#^l/'> 
fc». VLAN^V/i I P7 Kl'* t ©RISrStBKl^^ $*T, VSFiai^y- 
75fc»«rK^-CV^5 0 J>5 VLAN^>?7x-^fi£f)tlT< i I Pa-^j; Mi, /-?^r 
y h« s ill«fi-Stt31^>'^73i-^fciai:vLAN^^*8j:VI P7KuxSrtLtl>4 

r* h if ft b ft v* . r ft ic j: o . v s f ie ^7 5 * IE * - # gij © v s f ie *i it * y - * i 

P7K1/A*^r-7L, »J© V S F 0tta*tt*»£ft||c£X L, *5^ttavtf a - 
r -r > ? ? }) y K«tB©«^«r«j8i-S I p * _ 7 ^ y ; /:5S:!g£|£jl;-*-.5 <> ;ovLA 
N;?¥>-i/SrKJk-f5ia9*&T-l4, ii5££ (*7*A) f*- ft H L T Bib 

10 12 1] 

* * ft * ? H;-#7 1/-A^¥^»afcttflLt7 f -?/<^5' KD^^ftotU 
<> J.o*38 3Htt#£©* ¥v £ft,5 E. t liftl^. — *g M fc iftlf . m<o 

^atiaribi*, IEE8 0 2. lqOVLAN^*ftlLTl>5. E © «S] T If . 
VLAN/IPTFv^-Ittfi^S;, 7*"fcx*MfP-f-«fc«>lc802. \ * 9 9 
fiWA i ftG.-rZ>lPx9yt><0-V-7isX7-J*T'mft-rz t , E © 0? lc *J V> T , n y f ^ - r- 
-r > ^ 5 * tt . nyf a-r-r yriiis^twvLANCl^^tif gg^jisj; 5. 
VLANSJSI^y F?-^^^?!-^*-^' (NIC) TllS$fttV>5, 
[0122] 

0 1 7 Ii % i5VLAN^iIP7FMi: ©P8 fc&SlEi&^ir- SJgfiK© 7 a 

^Bl 7 0 0 Tfc5. ayfa-f^yj'^jgl 7 0 2 tiJ:yi 7 0 4I4« NIC17 
08j3ill>l 710^^U < VLANX-fyf 17'08 h v 1 ts X V v 2 fc -t H 

-?ft/iI{ig^£ftS„ VLANX-f yf 1 7 0 6 1), 7^-fe^^-f j/f 1 7 1 2*±t)!l 
7 14(CiHigjR£*T,5. ^-hv lfciVv 2tt, fM#:-e®l$,£tlZ. - SI 16 « IE 
■fctllf, IEEE 8 0 2. lqOVLAN^IUli, V L AN ^ ?f 1 7 0 6 K io 

[0123] 

IX m =• > f - /r 4 > ? ? V y K 

HLfcVSFIJ, i*«;Jj£fWANll:^ftJli,5„ 
[0124] 

-oW^feT'tt, y V V|4, #|s)«ijgi£*- K (ATM) isO#lE2ii'3V'>T V* "C 

t<k^ 0 E ©»•£-. §d-^/hi)7VLANI1, ATM L ANi $ a a ^ (L 

ANE) MifW-3!ffe5i;al'-f5' KLAN (ELAN) £<£fflL-Cj£JgElE&3f£ 

ft 5 „ :«±pi:, f-ovsFii, atm/sonet/oc-i 2!ix^i?cfto 

a>©£«y £#3,, ELAN 14. ATM WANf f CtjltS V L AN©- 

SB t ft S . 
[01 25] 
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ffiKOifft-eii, VSFJ:VPN^^7Atffi«lTWAN4($.l:fiilt5"o * H !£ « *5 
[0126] 

»»VSFKi8v^7 f -^trlll3tr-t8fc»lc:, 

r t # T* £ 5 „ fe 5 IM* , SANMATM^y ^v^y/ttliS AN^f^^tf^ h-f-t 

* ^ h (iiSS) y y y i> > ^ ft 2fti>&oa>0> s a n stw a n y y y ^ >- ^s^^ 9 t> 

©loJ:ffflLt, WANlCSAN^yy y^S^io I P tt: © J; 5 4* y h»7-^ 
±-eiB«ft < ttfF1-«0-C. lP*yf7-^ll:|**fifcSANliWANlt&*|: 

[0127] 

B 1 8 WAN«*±-C*tILfcl*OVSF©^Dy^B-C*5 t ir^/ifir:/*- 
5 0 #WAN«tttt. ±»LfcJ:5»CATM % E L A N 4 fell V P NgjR^ t,f« J 

j& £ ft 6 e W x. , ty;fty^iivsFi Afeir;7^ K/i/y-^A^tttv^ 
oty#-i:fc5vsF^ol(9STtfeiiftgfc»tTafl-e*5, c tf> J: ? ft ©j 9 *5 

[01 28] 

v s f <o m ffl « 

± IE ffil t?"R PKf:VSF7-dr7^7tli, !)x/f-^v/^7A(O^^T^i,LTt 

^oT. ±K«tt, ftSovs F|:is»t5CPUd^ij4 Lfc!>x^t-/<, 
iKr-^ayf-^ftttff-^-^t-^fcllLTIIlBLfc. L^L, VSF7-^ 

[0129] 

-.rt»5>tt* * h7-^<D-gfl<>: Lt(D»|VS F 

-**5«fc*5^T. VS F(i, £«VSFtftlUflS»«[*y (CDN) £ 

^ T* 5 0 * -t y v' ^ ^ * - /< © * y V V - * \t , « x. tf , Inktomi Corpo 
ration, San Mateo, California d» & JEX£ilTV*&Tr 
afficServer (TS) V7 hr)x75:tffi t T HJS T* # £ o TSIt^7^^7 

/^yf a-r>f y^Si^*^i:iiJDSnot, te35i"5o & o c p u to ii in » ffi 

[0130] 

rco^^gjc^VNT, v^r-M*, TSi«!f(0^t^>y^y7h>>x7S:lltft5VSF 
f± , afeW^&TCPUjo<^:^I/o^«ll^^v^T^!)Wlcffi^^5<t9Jc:«^^^^S 0 

[0131] 

- * * X s/ K *f > h 7 * V V T 7 ]) f — > 3 V <0 V S F 

h*5itffi*hfct-if7i it, 4|yy-^ 7 y^y^ (erp) , orm 

tSXlfCRMyy YV*Tt£X<D>(>Yy*y b 7 7^ y ^r - 3 y 

LT^6 0 Citrix WinFrame*>J;tfCitrix MetaFrameft 
if ©-fttfifc J: 9 , £3Stt * Wi ndows ( g & jgj H ) C E«8S t tt •> * 7 J f ft 
JfO/hM1^5-f 7^ UtOt-lf^ t LTM i c r o i o f t Windows ( 
XftifliB) 7yy*-5/ay«:iftt5r!:#t?*5 i V s F H: St « pjfgtc - o J: o UT 
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[0132] 

03 X fi > K 4 y <0 S A P Akt iengesel 1 s c h a f t ± 9 IE* J htt^S S 
AP R/3 ERPy7h^x7ia^ ^ itt^St^T / !) ^r - 3 V ioi t/f 

S*Sfctt»©JBtS<5^TVSFftll:St5fcftC, &SHIC#< ory y >r^v/ 
3^-9-- («xtf, SAPN/n^t-^) 4: V S F lC®j«||cii^i-5o 
[0133] 

ill:, C i t r i x Metaframe \ZL.i. 9 , JE K £ < C i t r i x U" — v< 5: ii 
JJOl-^rttCJ:?), j^^ts'F Windows (g&iSjgl) T^y^-^aVSrHtf-t*^ 
V - Ay r - A ± -C Windows (SBlSfll) T^J-i/aya-f ittjtsri* 10 
t*6. YSFKSU Ci tr ix MetaFrame V S Ftt, II: 

#<<OMe t a f r ame**^H5Wi ndows (g&iSfl) 7^!! ^ - a V <E> 
3.-1fS:iRSi-Sfcft|c:JE^^<<OCi t r i x^-/<*KlW(:ii^P-r^o £ < <£> I* ri> <£> 

[0134] 

- V S F t ^S^tiSf^ffl 

VSFfl*6fc«CttlJ*h5fcft, VSF-* rittij vsFiSitttafitt, /- 
VS F^^^^Y^Xf^tftlci/ri^it^v/^r A^Ii/Mcf Sl^K 
o vsFfll|iJfl^i^-yt^ltBPIl:tdc*5J:tf«I*li5©^, vsFi$ 

littttT * i? * #tf $ Jit , * e> V S F g # ££/£*5 ct t5«3E IT t J: ^ e #HT*i?* 20 

fl, * a: V>:fc i tf&^T ^ » $r- U 3 h - * i' * - K » IE * ^ & * * £ & , 

[01 35] 

-mmm v^T , -it^^y^-v^i, 3 ^f^-x^ v^K**'fc 

oTft«&jti5„ * * ?s<~ >>k ct t> % m&i*. m<o&. * Kaffir* it s = > * ^ 

-7 4 > y&m<Z>&. *B*i:»LT«fflSHS^-K!?*76J:Vy7 F!)x7/7^ 

h7t- a, ifoa^o^^y-^-^< x r^^-^nyf-/^ atcttx-*^-*^ 

:tiaot, #^^vsFitrtts:!;#tJ5. &oT, I^iKElftft^yy 
-^tUtrv^s. 30 

[0136] 

. 2 ft* <t % ^J^/^-^ftifflCl^tSVSF^i^L, VSF 

Sr H * iK "t" . 0c , I$|j:7yy>r-i/3 yOv^^-3^-^7 7/ D- KIT/V 

s f vmfflrz z t #-e# 5 0 

[0137] 40 

t> , H'^;M-K, P O * % , if 4 fc li fife © $ ft * ft if (O £ ft V> ic H 
[0138] 

*o*/hfttft**ton©vsF«)illiit*«8/h4^, joi^vsFt-^^Jv 
©H©loS:IRtS:t)ii'Cl8o iff * tt * * * if - ft ^ <0 # £ <0 1 K is.lt 5 = 
y^a-r^^ilol/hS; £ ii v s f a /h - /< m ft * *r l t ft it ti tf ft ?> ft 
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[0139] 

7 is a >&\£mi-Z V T^* 4 J*mmt:%.UL, ^ 7;^^f A)f il:g^< v s F 

©^aSrSttSr tdst?#5. ±IB#felcJ:?), if - 7 7 - ^ <D * ft Id » -J- 5 ft * <D 

(om^k* §l)»i:$It5:i:lj:Tli^ 0 

[0140] 

-vsF|:^t514^f/u io 

tt, vsFoayea-^-f y^B*i3J:tfB«»*©SI||ioftlKI^< VSFOB4 
^ef^Srffiffllt, VSFt»|ft5l«l:»Lt1f-lf^»4«:lll*t5:i#^*5 

®.mn$r&m$>xmt> v * -few-? v-^mm^mm-t z>n&& 

[0141] 

£ * i 0*ot-/<4ifO3yea-f ^y^B*o|*i[t»t8*-|» 20 

#&BTfcofcl$fflU:S^^"t\ ii*D*-^(OiiJD»&-cH4fe*ix6o C <0 «fc 5 <C R & 0> 
B*S*i8!iy-^lrR*LtU^. Wk&\*. MI PS^pffl, CPU 

^Pfl, CPUf»/^o|fiT'gLTUl/\ 

[0142] 
-ISg^Slf&JffilT'U-V'A P I 

STT'D^-^ay^D^^^^^y^x-^ (apt) ^^$(c^x.^-<tr*. $y 
»^TU^ 0 o T . IS^fflf lf;7/y^r-v' 3 y/n/7A|i, AP I £<£JB 30 

affirt ft iT4:g#-ra;:i :: tf> # ft ft , iS^3y^ a -f^^^y 5, KS 

» o T fcl 9 , B*^l/-y**i5IBAi:|l|fflt5ft«>lE7/Jir-^eyrp^7 
C;. A «r£S tt8^ lc<£ffl IT t J; v\ 
[0143] 
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METHOD AND APPARATUS FOR CONTROLLING AN 
EXTENSIBLE COMPUTING SYSTEM 

FIELD OF THE INVENTION 

Its piemnl mventwm rrJntea pmrnWy tn Anta jwtwAtiiig The htVCnhOT relates 
more Specifically tD a method md ap paratus for r frrrtr nftmg a enrn p trt rng gyf J, 

BACKGROUND OF THE INVENTION 

BmldCTi of Web Kites mi other computer systems today are faced wim many 



availabffity and site security. Accoaimhshii«1I>esco^^ 
trained persoirr^carrthto of m 

large end complicated. This has proven to be difficult for many organizationj because 
<ksigmng. cxmstructiEg end opczrfmg large sites is often outside their cere business. 

One approach has been to host in enterprise Web site ata(hinipartysite,co- 
locatod with other Web sites of other enterprises. Stjch outsourcing facilities are currently 
available from companies such bs Rxodna, AboveNst, GlobalCenter, etc These facilities 
provide physical space and redundant network and power facilities thired by nmhiplc 



Although outsourcing web ate hosting greatly reduces the bisk of estabhshing and 
maintain ing a web site, it does not relieve a company of all of the problems associated 
with maintaining a wob site- Companies must still perform many teaks relating to men- 
computing infrastructure in the course of building, operating an d graying flwiir facilities, 
Infcnnatkin technology managers of the enterprises hosted at such facilities remain 
responsible fbr manually aeiecting, installing, configuring, and maintaining their own 
computing e<ruipment at the facilities. The managers must still confront difficult issues ^ 
such os resource planning and handling peak capacity. Specifically, managers most 



handle me demands. Many nanagers ensure s^cient 

substantially more resources than are needed to provide a cushion against unexpected 
peak demands. Unfortunately this often m significant an ^wwiN ofmrused opacity 
that increases companies' overhead for hosting their web sites. 

Even when outsourcing companies also provide cemplrtw competing faciEttea 
mcbJding sennera, software and r»w 
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grow for the outsourcing company, bf^Pitffr giuwfli involves (he same imiiu«ri and error- 
prou oadm iiii s tjatr yg steps, maddiifcii, problems reman with capacity planrrmg fur 

EhrfW yrf> pmr uigwt Ky mil ^wn r-ing mmpanica often have gflcTCOt 

Eflnifajstai sod control fh*tr Wd> ctrt O&cr computes mscy icijuiic ft pttta c u lKr tjpc or 
levd of security that isolates their Web sites fiOTanoftonteathatareco-tocatedatan 

connection to an enteqmis luliuitet located elsewhere. 

Abo, variocs Web sites differ in internal topology. Some sites Empty comprise a 
row of Web servers that am load balanced by a Web load balancer. Suitable load 
balanccmereLccelDrrectm 

from Alteon, etc. Other sites may be constructed in a multi-tier rhsMon, whereby a tow 
of Web servers handle Hypertext Transfer Protocol (HTTP) requests, but the bulk of (he 
application logic is implemented in separate application servers. These application 
servers in turn may need to be connected back to a tier of database servers. 

Same of these different configuration scenarios are shown in FIG. LA, FIG. IB, 
and FIG. 1C FIG. lAb a btock diagram of asmmteWebcteyCornprismgasmgle 
computing element or machine 100 that inclndea a CPU 102 and disk 104. Machine 100 
is coupled to the global, packet-switched data network known aa the Intran et 106, or to 
another network. Machine 1 00 may be housed in a co-location service of the typo 
described above. 

FIG IB is a block diagram of a Mier Web server farm 110 comprising a plurality 
of Web servers WSA, WSB, WSG Each of the Webserver is coaled to a load- 
baJancex 112 mat iscoupted to rhtemet 106. The bad balancer divides the traffic 
between the servers to maintain a balanced processing load on each server. Load 
balancer 112 may alto incrodo or may be cocpled to a firewall for pr o tectin g the Web 
servers from unauthorized traffic 

FKJ. ICshowf a 3-tier server firm 120 comprising a tier of Web server* Wl, W2, 
etc, a tier of application terras Al , A2, etc., and a tier of database servers Dl , D2, etc 
The Web servers are provided fox hand ling HTTP requests. The application servers 
eaecntethebuJkofthc appUcstion logic The database servers execute database 
management system (DBMS) software. 
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Given the diversity in topology of fee kinds of Web eta thai need to be 
constructed tod the varying leijuij emails of Ac rr r rir ^j v> TT r t T ng companies) it may >|ipfJr 
thai the only way to construct Isrge-ecalc Web aitn is to physically ccstcm kriM each 
site, i n de e d . Bub is the convcnticnal ap proach . M^y ft f^ , it?7iytw ,n * qrw fffp^r**? ?y 
rtruggtng with the same iaaa, snd custom buikSag each Web etc farm scutch. This is 
inefficient rmd mvc+ves a significant sinrxml of duplicate work at different enterprises. 

Still anotbex problem wife the cuuvcutional approach is rcscmrcc and capacity 
planning A Web site may receive vastly different kvds of traffic an different days or at 
different hocra within each day. At peak traffic times, the Web site hardware or software 
may be unable to respond to requests in a xeasonable rime beca^ ft is overtnded. At 
other times, tbe Web etc hardware or software may have excesi capacity and be 
underutilized in the mn ran tipmi gymM*, fi™ffTg > fr?lynw frrtwegn hnvbq> prffiriirrt 
hardware and software to handlo peak traffic, without cwnring excessive costs or having 
over-capacity, is a difficult problem. Many Web sites never find me right balance and 
chronically suffer fium undeT^au^acity or excess capacity. 

Yet another problem is faihire frA«*»d by hnrnari error. A great potential hazard 
present in the current approach of using manually co nstru cted server f«m« is mat hnm?n 
orrox in configuring a new server into a live server farm can cause the server Cum to 
malfunction, possibly resulting in logs of service to users of flat Web alto. 

Based on the foregoing, there is a clear need in mis field fcr improved methods 
and apparatuses tor providing a computing system mat is instantly and easily extensible 
on demand without requi r ing custom construction. 

Thau is also a need for a computing system that support! creation of multiple 
segregated processing nodes, each of which can be expanded or collapsed as needed to 

There is a fur ther need for a method and apparatus for controlling such an 
extensible corcputaig system md its constituent segregated processing nodes. Other 
needs will become apparent from the disclosure provided herein. 

SUMMARY OF THB INVENTION 

According to one aspect of the mvenlion, the foregoing needs, and other needs 
and that will become apparent from the following description, are rchieved by a method 
and apparatns for controlling and managing a highly scalable, highly available and secure 
data pro ce saing sites, based on a wide scalo c onfutin g fabric pjaxnputing grid"). The 
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^m i p iit m g grM n pHycifrnTjy com t rncted "rtt^ and ftm logically divided np fbr varices 
C Bga fflta j joJU Otl de man d Thfr «nmpntpig grid comprises * krge phiraKty trf computing 
elements mat are coupled to one or more VLAN switches ami to one QX XDOrB Storage MltX 
network (SAN) swilohta. A pmTaffiytfstorage devices are coupled to (beSAN switches 
tnd maybe selectively coupled to one or more of (he computing dements through 
appropriate switching togto sod commands- One port of die VLAN switch is coupled to 
tn external network, sxxh u the Internet A snpervisory mechanism, layer, machine or 
process is coupled to the VLAN switches and SAN switches. 

TrttffftHy ^ aD storage devices coflBpntmg df tnr ji^? are assigned to Idle Pools* 
Under program control, the supervisory mcctenism dynamically configures &c VLAN 
switches and SAN switches to couple their ports to one or more computing dements and 
storage devices. As a result, such elements and devices are logically removed from the 
Idle Pools and become part of one or more virtual Ecrver farms (VSFs) or instant data 
centers (IDCs). Each VSF computing element is pointed to or otherwise associated with 
a storage device mat contiina a boot image usable by die computing dement fix bootstrap 

According to one aspect of the invention, the supervisory layer is a control plane 

process m cobinns ms c cmmutt ic B ti very coupled to one or more slave control process 

allocate slave control process mechanisms based upon slave control process meclwritimi 

resources. The one or more master control process mechanisms perform periodic health 
checks an the slave control process mechanisms. Nan-responsive or failed slave control 
mechanisms are restarted. Additional slave control mechanisms are h*ri tinted to replace 
slave control mechanisms that cannot be restarted. The slave control mechanisms 

control process mechanism has foile d, a slave control process mechanism a elected to be 
a new master control process mechanism to replace the failed master control uiocess 

Physically constructing the computing grid once, and securely and dynamically 
allocating portions of the computing grid to various org /i ai ftflho na on demand achieve 
economies of scale that are difficult to achieve when creating a custom buSd of each site. 
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BRIEF DBSOUPITON OF THB DRAWINGS 

The present invention is Unstated by way of examr^andnotbywayof 
Kmitation, in the figures of the accompanying drawing* and m which tike reference 
numerals refer to similar dements and in which: 

FIG. IA is a block, dizgntm oft cmpic Web etc having i tingle competing 
dement topology. 

FIG. IB is a block diagram of a one-tier Web server farm, 

FIG. 1C is a block diagram of a three-tier Web swycrfann. 

FIG. 2 is a block diagram of one amfigirnmori of an extensible confuting system 
200 th2t mcrudei a local computing grid 

FIG. 3 is a block diagram of an exemplary virtual server rann featuring a SAN 

Zone. 

FIG. 4A, FIG. 4B, FIG. 4C, sod FIG 4D are block diagrams showing successive 
steps involved in adding a computing clement and removing element from a virtual server 
farm. 

FIG. 5 is a block diagram of an embcKiiment of a virtual server farm system, 
computing grid, and supervisory m <-rf» i »n i ^ 

FIG. 6 ia a block diagram of logical connections of a virtual server firm. 

FIG. 7 is a block diagram of logical connection! of a virtual server farm. 

FIG. 8 is a block diagram of logical connections ofa virtual server farm. 

FIG. 9 ia a block diagram of a logical relationship between a control plane tod a 
data plane. 

FIG. 10 is a state diagram of a master mrtml election process. 

HO. It is a state diagram for a slave control process. 

FIG 1 2 is a state diagram for a master centred process. 

FIG. 13 ia a block diagram of a central control processor and multiple control 
planes and computing grids. 

FIG. 14 is a block diagram of an architecture foe implcocEting portions of a 
control plane and a computing grid. 

HO. 15 u a block (tiagjam of a rystem wim a ce>n^ 
afirewalL 

FK3. 16 is abloc* diagram of aaarr±itec^ 
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FIG. 17 a b bbci diagram of m crangemcal far arfbrciri^ tigbt binding between 
VIAN tigs and P addresses. 

FIO. IB ii a Mock diagram of apluraHJy of VSFa extended over WAN 
c onrtrrtront 

FID. 19 is a block diagram of a computer system with which an embodiment may 
be LuiplrJOHTted. 

DETAILED DESCRIPTION OF 1HB INVENTION 

(Wi lB STB m uuiu m OTua CO pTOYlGe S mCZOOgn. UUlWRaTBlTng OI UJC (uoum UiVUUlOIL 

H will be appaicnt, however, to one skilled in the art thai the pr e sen t invention may bo 
practiced without these specific de tai l s. Is other instances, well-known structures end 
devices are shown in block diagram foxm in order to avoid unnecessarily ohsconng me 
present luvenuon. 

VIRTUAL SERVER FARM (VSF) 

Ac co r di ng to one embodiment* a wide scale computing Ctbric ("c o ii ipu ting grid") 
la provided. The cocrnruting grid may be physically constructed once, and then logically 
partitioned on demand. Apart of the comp uti ng grid is allocated to each of a plurality of 
enterprises or organizations. Bach organization's logical portion of the computing grid is 
referred to as a Virtual Server Fann (VSF). Each organization, retains independent 
a dminu uuuvo contiul of its VSl*. Each VSF can change dy namicall y in teuns of number 
of CPUs, storage ca p a ci ty and disk and network bandwidth based on real-time de mand s 
placed on the server farm or other factors. E a c h VSF ia secure from every other 
organization's VSF, even though they are all logically created out of me same physical 
computing grid. A VSF can be c onne c t ed bock to an In U m i rt using either a private leased 
hue or a Virtual Private Network (VPN), without exposing the Intranet to other 
otgafliiationrf VSFa. 

An orgujirzaiion can accega only the data and cocunaing elements to the portion 
of the computing grid allocated to it, that ia, in its VSF, even though it may excrciso full 
(e.g. super-user or root) ndnnmstratrve access to these computeni and can observe all 
traffic on Local Area Networka (LAKs) to which these computers are connected. 
According to one embodiment, this hi accomplished using a dynamic firewafling scheme, 
where the security r^jimeter of the VSF expands and shrinks dynamically. Each VSF can 
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be used to beet the ooctent and ap plication s of to mgiUtLualtoo that may be a c c e sse d via 
flic Internet* Intranet or Extranet 

Confignraitcm and coctrol of the competing elements and their assoriated 
networking and storage elements is performed by a srycrruKgy rmrham'gn that jj not 

ixuivitiicjicc, in this document the supcjvisusy mcchanisin is referred to generally as b 
wllL»] plane end may comprise one or more processors or a net twik of processors. The 
super visoty mochiintfi m may com p rise a Supervisor, Controller, etc Other approaches 
gray bo used, as described hereia. 

The control plane is urrpternsnted on a ownprfttJy independent set of coorptrhng 
e lem ents a s s i gn e d for mper v ii wy pcrposea; such as oca or more servos that may be 
mtaeormectcd faanetwodcorbyoa»raearis. The control plane pcr fonns oontrol 
•tctioos 091 ths com piiti rv^ nftt wmtfcn^ sod stor&£o descents of tfoft c oui jwrtin^ tfw opgfr 
special control porta or interfaces of the networking god storage elements in the grid. The 
control plane provides a phytical interface to twitching elements of the system, memtars 
loads of computing rimntti m the eyrtwn, wrvt prnvirff-q n^T n TTP«J^P^ t)A rn*nag>mrDt 
functions using a graphical user intrrrace or other suitable user iirterfkce. 

Computers used to nnplernrot the control plane are logically invisible to 
computers in the computing grid (and therefore m any specific VSF) and cannot be 
attacked or subverted in any way via elements fa the coinputing grid or from catenal 
computers. Only the control plane has physical attractions to the control ports on 
devices in the computing grid, which controls membership in a particular VSP. The 
devices in the conrputingcan be configured cmly through these special control porta, and 
thereforo computing elemeiits in the computing grid ore unable to change their security 
perimeter or access storage or conrputing devices which they are not authorized to do. 

Thus, a VSF allows organizations to work, with computing facilities that appear to 
cornprise a private server farm, dynamically created out of a largo-scale shared computing 
i nfra st r ucture, namely the computing grid. A control plana epnrfod with tee oo mp a t fag 
arthitrctare described herein provides a private server firm whose privacy and integrity is 
protected through access control mechanisms implemented in the hardware of the devises 
of die computing grid. 

The control plane controls the internal topology of each VSF. The control plans 
can take the basic mtercounection of computers, network; switches and storage network 
switches described herein and use mem to create t variety of server farm configurations. 
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These mclodc but arc not limited to, aogto-txer Web cover fitting front wanted by a load 
balancer, as well as multi-tier coiiDgU Htktu a, where a Web server talks to an apphcalinn 
server, which fn torn tiDcs to a datab ase server. A variety of load halip/iug, nrnhj-frermg 



THE COMPUTING GRID 

The computing grid may grist in a single location or my be diftlnbvtcd over a 

bmldicg-erzed netwoik, composed purely of local area technologies. Then the document 
describes the case where the cojupuUiig grid is distributed over • wide area network 
(WAN). 

FIG. 2 is a block diagram of one configuration of an extensible computing system 
200 mat includes a local co mputin g grid 208. In fins document "extensible" generally 
means mat mo system is fle xi b le and scalable, having the capability to provide increased 
or decreased computing power to a particular enterprise or pact upuu demand. The local 
computing grid 208 is com p os ed of a large number of emnpotmg elements CPU1, CPUS* 
...CFUn. In an exemplary embodiment, mere maybe 10,000 computing elements, or 

soch as a local disk. Instead, all long lived state m&mntta is stored separate from the 
computing elements, on disks DISK I, DISK2, ... DEKntbat sre coupled to the 
computing elcmen ta via a Storage Area Network (SAN) comprising one or more SAN 
Switches 202. Examples of suitable SAN switches me commercially available from 
Brocade and Excel. 

more VLAN switches 204 which can be divided up into Virtual LANs (VIANs). The 
VLAN switches 204 are coupled to the Internet 106. m general a c omputin g element 
contains one or two network mterfaee* conxtected to me VLAN For me sake of 

simplicity, in FIG. 2 all nodes are shown with two network mterfircea, although come may 
have less or more network interfaces . Many commercial vendors now provide switches 
supportmgVLANmoerion^ For example, suitable VLAN switches are commercially 
available from Systems, Similarly there arc a large 

number of coxmnercially available products to constract SANs, including Fibre Chaund 
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switches SCSI^F2H«<aHnnd bridging device^ 

Ccctrol plane 205 is celled by a SAN Control path, CKJCoimvl path, and 
VLAN Conlrol path to SAN switches 202,CmCPlJl, CT^ ... CPUa.aadVlAN 
Switches 204, respectively. 

Esch VSF b composed of a set afVLANs, a set of compun^ elements Oat are 
attached to me VLANs, and a subset of the oonge available on the SAN thai is cooplcd 
to tho act of competing elements. The subset of the storage avmkble on the SAN ia 
itfanJ to as a SAN Zone end is protected by flte SAN hardwire from access from 
congwtii^dcmciilBthalarep^ofotha-SANK^ Preferably, VLANs that provide 
non-torgeab)e port identifiers are used to prevent one cos tamer ar cod oser from 
obt ainin g access to VSF resources of another customer or end user, 

FIG. 3 is a block diagram of an exemplary vrimal server isrmfeatoimg a SAN 
Zona A plurality of Web servers WS1, WS2, etc^ are coupled by a first VLAN 
(VLANI)toaloadbahmccr(LaiymYwan3Q2. A second V1AN(VXAN2) couples the 
Intend 106 to the k>ad balancer (l^yfiiewsiim Each ofthe Web servers may be 
selected from among CPU!, CFU2, etc, using me chanis m* dc*aihed fatter herein The 
Web servers are counted to a SAN Zone 304, winch is coupled to one or more storage 
f devices 306a, 306b. 

I At any given point in time, a computing element in the compiling grid, such as 

CPU1 of FIG. 2, is only f o u mrtrd to the set of VLANs and the SAN zone(s) associated 
witharicglsVSF. A VSF typically is not shared among different organizations. The 
subset of storage on the SAN that belongs to a single SAN zoos, and the set of VLANs 
associated with it and the conmuling elements on these VLANs define a VSF. 

By controlling the rnerruVsrEhip of a VLAN and the membership of a SAN rone, 
control plane enforces a logical partitioning of the computing grid into multiple VSFi. 
Members of cme VSF carrootacoen 

Such access restriction are enforced at the hardware level by (he VLAN twitches, ami by 
port-lcvd access control mechanisms (e.g^ zoning) of SAN hardware such as Fibre 
Channel switches and edgs devices K uch as SCSI to Fibre Channel bridging hardware. 
Commuting, elements mat form part of the co mputi ng grid are not phymraPy corrnerted to 
the control pcrtj or mtejfaces of me V^ 

cannot control themernbernhip ofthe VLANs or SAN zones. Accordingly, the 
-9- 
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ecu npnfing eiemena of (bo computing grid cannot access onnrnntrrtg dementi not bcated 
to, the VSF to which Bay axe ccfflapod 

n»iiy flu f^imjmtTttg riwnwiti tfnrt rrm the plane are pfcysicaOyccsmected 
to (he cuiiiiij pcrti or rata ftoc of the devices in the grid. Devices m fhs conpcti&j grid 
(computers, SAN switches and VLAN twitches) can only be configured flnoogh snch 
control porta or interfaces. This provides i xirnplo yet highly secure means of enforcing 
the dynamic partitkxnng of the computing grid into multiple VSFs. 

rjiffh coppnlmg dnncf it m s VSF is replaceable by any other oonyurai^ c looD C Pl 
Tbo number of computing dauenfs, VLANs md SAN zones associated with a given VSF 
may change over time under control of the control {dsns* 

hi one embodiment, (ho computing grid includes an Idle Pool (hat comprises large 
manber of competing dements that are kept in reserve. Cc^npisingelezncxtfs&orntho 
Idlo Pod may be assigned to a particular YSP for reasons each as incrcamig the CPU or 
memory capacity avaflabto to that VSF, or to deal with fkihtrq of a pntkular oomputiug 
element in a VSF. When fha co mpu t in g rjemmt* iqn ronfi^rr^ ^ sTrfTTw, (hp Mrg 
Pool serves as a large "shock absorber" for varying or Trarsty" Web traffic toads tnd 
related peak processing loads. 

provides economies of scale, since do snrgle organization has to pay for tits entire cost of 
the Idle PooL Different organizations can obtain computing elements from the Idle Pool 
at different times in me day, ts needed, thereby m»Mtn E exh VSP to grow when 
required and shnnk when traffic fliUs down to normal. If many different or gs b i tat toos 
continue to peak at (he cunc time imd thereby potentially eximisl Qio capacity of (he Idle 
Pool, the Idle Pool can be increased by adding more CPUs end storage dements to it 
(scalability). The capacity of the Idle Pool is engineered so as to greatly reduce the 
probability that, in steady sate, a partkuha VSF rn*y not bo ehlc to obtain aa additional 
ccmptmng elemenlfrom file Idle Pool when it needs to. 

PK3- 4A, FIG. 4B, FIG. 4C, and FK3. 4D are block diagrams showing successive 
steps rnvedved in mtrving a computing ehanrxrt in and out of the Idle PooL Referring first 
to FIG. 4A, aswTTTif! feat the ooclrol plane has logically connected dements of the 
computing grid into first aod tecond VSFs libeled VSF1, VSF2. Idle Pool 400 comprises 
a phnsliryofaVs 402,0116 of wto . 
* need far an additiond occupy Accordingly, me control p la ne m o v e s 

CPUX from Idle Pool 400 to VSF1, as indicated by path 404. 
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hi FIG. 4C, VSF1 no longer needs CPUX, and therefore the control plane moves 
CPUXoctofVSFl and back into to Idle Pool 40d In FIG. 4D, VSF2 has developed a 
need for m tddMon al c om p etin g chan cel Accordingly, (he control plane moves CFUX 
from (he Mle Pool 400 to VSF2. Thus, over (he course of time, as traffic conditions 
change, a shnde cornputrpg dement may belong to the Idle Pool (FIG. 4 A), then be 
assigned to a particular VSF (FIG. 4B), then be placed back in the Idle Pool (FIG 4CX 
end thea belong to another VSF (FIG 4D). 

At each one of these stages, the control plane configures the LAN twitches tad 
SAN switches associated with (hat computing eFrrofrt to be part of the VLANs and SAN 
mnea associated with a particular VSF (or the Idle Pool). According to one embodiment, 
in between exch trznsincn, the computing clement is powered down or lebooted. When 
the computing clement is powered back up, the competing element views a diflbrcnl 
portion of storago 7nnfi on me SAN. hi paificnlar, the comjy^r^Q p^nrmnt views a portion 
of storage zone on the SAN that includes a bootable of an operating system (e.g., 
Linux, NT, Solaris, etc.). The storage rone also mclndes a data portion that is specific to 
each organization (eg, files *?$n*i*teA with a Web server, database partitions, etc). The 
c omputin g element is also part of another VLAN which is part of the VLAN set of 
another VSF, so it can access CPUs, SAN storage devices and NAS devices associated 
with the VLANs of the VSF into which it has been transitioned. 

logical blueprints that are associated with tolas mat may bo assumed by the computing 

as Web server, application server, da t a bas e server, etc. The role of the computing 
element is ncruiirrd from one of a plurality of pre-defined, stored brocprfnta, each of 
which defines a boot image for the computing elements (hat are associated with that role. 
The blueprints may be stored in the form of a file, a database tabic, ox any other storage 
format mat can associate a boot image l o ca ti on with a rote. 

Thus, the movemema of CPUX in FIG. 4A, FIG. 4B, FIG 4C, FK3. 4D are 
logical not physical, and are accomplished by re-configuring VLAN switches and SAN 
Zones under control of The control plane. Further, each computing dement in tbo 
computing grid initially is essentially fungible, and assumes a specific processing role 
only after it it connected in a virtual server farm and loads software from a boot image. . 
No conmutmg ckment is dedicated to any particular role or tasic such as Web server, 
spphcatiou server, database server, etc. The role of the campuirng element is acquired 
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Hum ooe of a plurality of pn Miriin ed. stand blueprints, each of which is associa t ed with 

Since there is do long-lived stale information stored in any given competing 
deport (inch as a local <fiat% nodes are easily moved betweep diflensai V$i% and can 
run completely different OS and sppHcattoD software. This also p*^** each oosirpQtrng 

i4*ai\rni tnghly rryW^ajd^ fr> r-atn nf pl«im#rf r» rmfAwnnrA dOWBttlPe 

A particular mnnp H ^ng ^t^i'iw^ may i^ Ph*** di^ T^TT^ r^y ^ s m jj u brought faito 
aodoid of various VSPe. For example, a computing dement may act sa a Web saver in 
one VSF, and when it is broegbi into a difibcut VSF, it may be a database server, a Web 
load balancer , a Fuewall, etc It may also successively boot and run different operating 
systems inch as Linux, NT or Solaris in different VSFa. Tbas, each cwimrrrmg earned 
in the computing grid is fungible, and has do static role assigned to it. Accordingly, the 
entire reserve capacity of the computing gridcanbeused to vide any of (he services 
required by any VSF. Tins provides a high degree of av ailabilit y and rel iabil i t y to the 
services provided by a single VSF, bemuse each server personnrhg a particular service 
has potentially thousands of back-up servos able to provide the smao tcivioc 

Former, the large reserve capacity of the computing grid can provide both 
dynamic had balancing properties, as well as high processor availability. This capability 

VLANs, and connected to a configurable zone of storage devices via a SAN, all 
controlled in real-timo by the control plana. Every computing pigment can act in the role 
of any required server in any VSF, and can connect to any logical partition of tny disk in 

the SAN. Whm dm grid raqnrrea mnra computing power rw tticfr t^pofjty ropf pn^^g 

dementi or disk storage is manually added to the idle pool, which may decrease over 
fans as rooro orgiLiiilzAliULLi aro provided V&y services. No manual intervention is 
referred hi order to increase me iwmhcr of CPUs, network and disk baud width and 
storage available to a VSF. All such resources are allocated on demand from CTU, 
network and disk resources available in the Idle Pool by me control plane 

A particular VSF is not subjected to manual recorifigiuation. Only me computing 
dements in the idle pool are manually crmfignpM prfo the own rm ting grid As a result, a 
great potential hazard present in coaierrtmarnialh/ constructed sem 
The possibility that human orar in configuring a new server into a hve server farm can 
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cause tfag bUvT^i [aw to inalfoncttao, possibly resulting in loss of service to nscrs of that ■ 
Web site, is virtually dnnrftated. 

thai failure of toy particdar storage ekmnxt docs oot csnse a lea of service to any part 
of the system. By dccocpling Imrg-fived storagr, from computing devices using SANs, 
md by providing r edundant stooge sod co mp uting elements, when ray computiug 
clemc B t can be attached to any ttoragc partition a bigfa degree of availability is achieved. 

A DETAILED EXAMPLE OP ESTABLISHING A VIRTUAL SERVER FARM, 
ADDING A PROCESSOR TO IT, AND REMOVING A PROCESSOR FROM IT 

FIG. 5 is a block diagram of a computing grid and control plane mecharrisni 
according to an embodiment With reference to PIG 5, fee toDowing describes the 
detailed steps that may be used to create a VSF, add nodes to it and delete nodes from it. 

FIG. 5 depicts comparing dements 502, comprising computer* A through G, 
coupled to VLAN capable switch 50*. VLAN switch 304 ts coupled to Internet 106, end 
mo VLAN switch has ports VI, V2. eta Computers A through G ire further coupled to 
SAN switch 506, which is coopled to a plurality of storage devices or disks D 1-D5. The 
SAN switch 506 has ports SI, S2, eta A control plane mechanism 508 is 
co m mnntf-fltivcly coupled by control paths and datapaths to SAN switch 506 and to 
VLAN switch 504. The control plane b able to send control commands to these devices 
through (he control ports. 

Far the sato of rinrrdiraty imd rr preark-m, the mnabcr **f eegnputing dements in 
FIG. 5 is a small number, m practice, a large number of comr^iters ag^ thousands or 
rase, and an ecp^ally large immbc7 of msuch 
larger structures, multiple SAN switches are ii i i *raninn*rfr *i to farm a mesh, sod multiple 
VLAN switches are mterconnected to form a VLAN mesh. For clarity and simplicity, 
however, FIG. 5 shows a single SAN switch and a single VLAN switch. 

ImtiaDy, all computers A-O arc assigned to the idle pool until the control plane 
receives a request to create a VSF. All ports of the VLAN switch are assigned to a 
specific VLAN which we shall Uhel as VLAN I (for the idle zone). Assume that me 
control plane ta asked to construct a VSF, c ontnimng one load balancer/firewall and two 
Web servers connected to a storage device on the SAN. Requests to control plane may 
arrive through a managrsuent Tn ^*rf*'** or other computing el emen t 
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In response, the control plane assign* or allocates CPU A as the load 
balancer/firewall, and aDocatos CPUs B and C as fee Web servers. CPU A is logically 
placed m SAN Zone 1, and pointed to a bootibte partition cm i disk feat CGBtrins 
dedicated load t**i«ivJwgftir«»iKiig software. The tenu pointed to** is used for 
convenience and it intended to indicate feat CPU A is given, by any ttwitw, info rm aH oo 
sufficient to enable CPU A to obtain ox locate appropriate software that it needs to 
operate. Haee m e n t of CPU A in SAN Zone 1 enables CPU A to obtain re so u rces from 
disks that sic controlled by the SAN of thai SAN Zone. 

The load balancer is configured by fee control plane to know about CPUs B and C 
as thotwo Web servers it is supposed to toad balance. The firewall con fi g ur ation protects 
CPUs B and C against unautbotLsed access from the Internet 106. CPUs Band Care 
pointed to a disk partition on the SAN that contains a bootable OS image for a particular 
operating system (eg, Solaris, fjnui, NT etc) and Web server application software (e.g^ 
Apache). The VLAN switch is configured to place ports vl and v2 on VLAN 1, and 
ports v3, v4, v5, v6 and v7 on VLAN 2. The control plane configures (be SAN switch « 
506 to place Fibro-Cbannel switch poets si, s2, a3 and s8 into SAN zone 1. 

A description of how a CPU ii pointed to a particular disk drive, and what this 
means for booting up and shared access to disk data, is provided further herein. 

FK3. 6 is a block diagram of die resulting (he lo^caJcocmectivityofcoffirajrmg 
elernenta, which are collectively called VSF1. Disk drive DDI is selected from among 
storage devices Dl, D2, etc Once the logical stmctnro as shown in FB9. 6 ia achieved, 
CPUs A^ C are givm a r«wewm command, m response, CPU A becomes a dedicated 
load balanwr^fiTcwaU-compohng el on rot, and CPUs B, C become Web servers. 

Now, assume that b ec a u s e of a policy-based rule, (he control plane determines mat 
another Web server is required in VSP 1. This may be caused, for example, by an 
increased number of requests to the Web site and the customer's plan permits at least 
three Web servers to bo added to VSF 1. Or it may be because the organization that owns 
or operates fee VSF wants another server, and has added it through an adxnirnstrative 
medurtism, such as a privileged Web page that allows it to edd more gctvcib to its VSF. 

In response, the control plane deciika to add CPU D to VSF 1 . m order to do this, 
the control plane will add CPU D to VLAN 2 by «Wmgportsv8andv9toVlAN2. 
Abo, CPU D"s SAN port U is added to SAN zone 1 . CPU D is pointed to a bootable 
portkffl of fee SAN storage that boots up and runs as a Web server. CPU D also gets 
read-only access to the shared data on fee SAN, which may consist of Web page contents, 
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executable save* sc ripts , etc. Thb way Ubab)c to scree Wd) rcqta^mtcoded fo6e 
server tarm much as CPUs B and C serve requests. The control plane will iIjo configure 
the toad balancer (CPU A) to mctodc CPU D ks pzrt of the server set which ii being lead 
halroeedL 

CPU D is now booted up, and the size of the VSP has now increased to three Wcfa 
savers and 1 load balancer. FIG. 7 ts a block diagram of Ore resulting logical 
connectivity. 

As s um e fijal the control plane now receives a request to create another VSF, 
which it will name VSF 2, and which needs two Web servers and one load 
balancer/firewall the oodrol plane allocates CPU B to bo (he toad bdaaccrffircwali and 
CPUs F,G to be the Web servers. fteottftameaCPUBtotaKwab^ 
two computin g d em enti to toad balance a gainst 

To irrrplanect this ccmfigimrtian. the control plme will configure VLAN switch 
504 to include port vlO, vl 1 in VLAN 1 (that is, cramectedtothektemrf^ 
vl2,vl3ondvl4,vl5tobemVLAN3. SinnTaify, ft configures SAN switch 506 to 
irttlndeSANportss6ands78rtds9inSANtone2. This SAN tone includes (he storage 
oorrlnrrTTng (he software necessary to run CPU Em a load-balancer and CPUsF tad Gas . . 
Web servers that use a shared read-only disk partition contained in Disk D2 in SAN rone 
2. 

FIG. 8 is a block diagram of the resulting logical connectivity. Although two 
VSFs (VSF i, VSF 2) share toe same physical VLAN switch and SAN switch, the two 
VSFs are logically partitioned. Users who access CPUs B, C, D, or the cntapriso that 
owns or operates VSF 1 can oityscciMliw Such users 

cannot access the CPUs or storage of VSF 2. This occurs because of the combination of 
the separate VLANs and the 2 firewalls on the only shared segment (VLAN IX and the 
difierent SAN zooes in which the two VSFs are configured. 

Furthaassirme that later, toe a 
down to two Web server*. This may be because OMterrrpca^ 
has decreased, or it may be because of conic other administrative action taken, hi 
rcspc^ the control plarrcwmshrt 

include powoing down the CPU. Once the CPU has shut down, (he control pbne 
rerrx»vespcotsv8imdv9n^VlAN2,andalro 

Port s4 is placed in an idle SAN rone. The idte SAN lone may be designated, fig 
example, SAN Zone 1 (far Idle) or Zone 0. 
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Scms time brta, the control pbrrm may decide to add ancfliErnode to VSF 21 This 
may be b e c au se flic load an the Web to vets to VSF 2 has t wu ponrDy increased ox tt may 
be doe to other reason* Acuxdhsgly, the cantitjH c^aneoVcides to place CPU D in VSF 2, 
as fadrcated by dashed path 802. la order to do A"*; it configures fee VLAN switch to 
include ports vS, v9 fn VLAN 3 rod SAN pert s4 in SAN rone 2. CPU D is pointed to 
the patties of the storage on disk device 2 that contains a bootable rmagp of (ho OS rod 
Web server software required for servers in VSF 2. Abo, CPU D is granted read-only 
access (d data in * file ryrtcm shared by (he other Web servers in VSF Z CPU D is 
poweied back op, and it now runs as a load-balanced Web server in VSF 2, and can do 
longer access any data in SAN zone I or the CPUs attached to VLAN 2. In particular, 
CPU D has no way of accessing any dement ofVSF 1, even tbongh at m earlier point in 
time it was part of VSF 1. 

Further, in this configuration, the seenrfty perimeter enforced by CPU E has 
dynamically expanded to nrr rw dr CPU D. Urns, embodiments provide dynamic 

wdded to or removed from a VSF. 

For purposes of explanation, embodiments have been described heron in (he 
context of part-based SAN wrtfng, Otbertypcsof SAN zomns may also be used. For 
example, LUN level SAN racing may be used to cr eate SAN zones based upon logical 
vommesvithm disk arrays. An example product that is suitable for LUN level SAN 
wffHTtg is the Volume Logics Product from EMC Corporation. 

DISK DEVICES ON THE SAN 

There are several ways by which a CPU can be pointed to a particular device on 
the SAN, for booting up purposes, or fix pe c csaps g disk s t orage which needs to be shared 
with other nodes, or otherwise provided with information about where to find bootnp 
programs and data. 

One way is to provide a SCSl-to- Fibre Channel bridging device attached to a 
co mputin g element and a SCSI mterface for the local disks. By routing that SCSI port to 
the right drive on the Fibre-Channel SAN, the computer can access the storage device on 
the Fibre<5iarmd SAN just as it would access a locally attached SCSI disk. Therefore, 
software such as booMrp software smmry boots off the (tide device on the SAN just as it 
would boot offa locally attached SCSI (hat 
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Another way it to have a Fibre-Osnmd M 1 ^^ on the rede tad associated 
device-driver and boot ROM and OS software that permits the Khio-Channel interface to 
be used aa a boot device,. 

Yet mother way is to have an interface card (eg, PQ bm or Sbos) which appcara 
to be a SCSI or IDB device controller but that m tnzo commanicates over &e SAN to 
access the disk C^eratmg systems such as Solaris integrally provide distless boot 
firncfioni thai cap be used in this altemarrye. 

Typically there will bo two kinds of SAN disk (kniixs associated wrth a given 
node. The first is one which is not logically shared with other competing dements, and 
ccmstitnleswhtf ^ 

local configuration files, etc, Thisii the eourvalentofmo root fib system on a Unix 
system 

The second kind of dkx is ihartd storage with other nodes. The kind of sharing 
varies by the OS software running cm (he CPU end the needs of (he codes fccceasaig the 
shared storage. If the OS provides a cluster file system mat afiows read/writo access of a 
shared-disk partition between multiple nodes, the shared disk is mounted as soch s clnster 
file system. Similarly, the aystem may osc database software such as Oracle Parallel 
Server that permits multiple nodes naming in a chafer to have conenrrent read/Wri to 
access to a shared disk. In soch cases, a shared disk is already designed into the base OS 
and application software. 

For o perating systems where such shared access is not possible, because the OS 
and associated appl icati o n s cannot manage a disk device shared with other nodes, the 
shared disk can be mounted ta a read-only device. For many Web applications, having 
read-only access to Web related files is sufficient. For example, in Unix systems, a 
particular file system may be mounted as read-only. 

MULTI-SWrrCH COMPUTING GRID 

The configuration described above in conne ct ion with FIG. 5 can be expanded to a 
large rrumber of computing and storage nodes by mtercom 

switches to form a large switched VLAN fabric, and by interconnecting multiple SAN 
switches to form a large switched SAN mesh. In Otis case, a computing grid has the 
architei^ generally shown in FIG. 5, except that the SAN/VLAN switched mesh 
cemtaim a very large mrnftxa of porta f^ Amrmbcrof 
computing elements running the control plane can be physically connected to the control 
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ports of fiwVLANSAN switches, as de«cribod finfberbetow. Btoomwtioaof 
Bmltqtto VLAN switches to create cotnpJg ugtbi'GttBpos datanctworics a known in this 

See, for ^ytwjpj^ G~ Haviland, *TJcsigmng ffigh— *^^rf'c t PT** n r ^ Ompm hfrana ti 
with Multilayer Sw it ch in g^ Cisco Systems, mc, and m thmwtkm available 6cm 
Brocade. 

SAN ARCHTTECTURB 

The drsrripttori assumes Oat the SAN roimprisri Fihre<2fflrmcl switches and disk 
devices, and potentially Flbrtv-Qumnd edge device* such aa SCSUo-Fibre Cbsnad 
bridges. HuwtVva, SANs may be constructed nsing alternati ve technologies, soch aa 
Gigabit Ethernet switches, or switches that use other physical layer protocols, m 
particular, there are efforts correctly underway to construct SANs over IP networks by 
running (be SCSI protocol over IP. The methods a^d architecture described trxrvc ii 
adaptable to these alternative mcthodi of coustiucting a SAN. When a SAN is 
constructed by nmning a protocol like SCSI over IP over a VLAN capable layer 2 
environment, then SAN zones are created by mapping them to different VLANs. 

Also, Network Attached Storage (HAS) may be used, wbich works over IAN 
technologies soch as fast Ethernet ca Gigabit Ethernet With thia option, different 
VLANs are used in place of tho SAN zones in order to enforce security and (he logical 
partitioning of (he computing grid. Such NAS devices typically support network file 
systems such as Son's NSF protocol, or Microsoft's SMB, to allow multiple nodes to 
share the same storage, 

CONTROL PLANE IMPLEMENTATION 

As described heron, control planes may be Tnrplr 1 ""^^ as one or more 
processing resources thai are coupled to control and data ports of the SAN end VLAN 
switches. A variety of control plane inrplementaliona may be used and the rmrention is 
not limited to any rejrticolar control plane mmjemerTtBtirm. Various aspects of control 
plane bnplianentation are described in more detail in tha following sections: 1) control 
plane architecture; 2) master segment roanaga election; 3) adrnunrirative- functions; and 
4) policy and security c on si d e r ations. 

1. Control Plane Archi te c tu re 
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According to one embod i v a control p^* 1 ^ is fiMj'If^nw ifrd 33 & conTrol 
process hierarchy. Tfvi corrliol process hierarchy prx»i-»tly mrlnH^ nj nrr* - n urf ^ 
segmcai manga mechamma that are commmnatfiTdy coupled to md control one or 
more d»vft y^gpi*7it manager rv^^nip"? The ana or mote dare te gme ra i m a na ger 
mechanisms ccm^rol one Orinoco farm managers. The one or more firm managera 
iiuMiigft ooc or irjoro V SF s, Tlx roaster sod slave bc^picpI DBmajff mci fcsflisDM may be 
ODptoitCntDd in hardware circuitry, computer software, or toy combustion thereof 

FIG. 9 is a block diagram 900 that illustrates a Logical relationship between a 
control piano 902 and a oompgrting grid 904 according to occ embodiment Control plane 
902 controls sod m a nage s computing nrtu/m^cm^ ktiA ritnagp. ^f^f^f^ contained in 
co mpu t in g grid 904 through special control ports or interfaces of the nst wr o dan g and . 
storage dements in compating grid 904. Computing grid 904 includes a irrrmber of VSP« 
906 or logical resource groups created in accordance with an ernboftnnrl as previously 
described herein. 

According to one emhtxfiment, enntml phmc Oft? mcfadei ■ mfftr rr gj nrri 
manajgr 90S, one or more slave segment mmagen 910 snd One or more fsmi managers 
912. Master segment manager 908, slave segment managers 910 md farm manager! 912 
may be co-located on a particular ccrnrruifng platform or may be distributed on multiple 
computing platform a For purposes of aplanatiari, only & single master segment manager 
908 is illustrated and described, however, any number of master segment managers 908 
maybe employed. 

Master segment manager 908 is coarmrnricatrvefy coupled Co, controls and 
manages slave segment managers 910. Bach slave segment manager 910 is 
commTTntcclively coupled to and manages one or more farm m an a g er s 912. According to 
one embodiment, each farm msnngv 912 is co-located on the some computing platform 
as the conesponding slave segment managers 910 with which it is oc&rrmunicativdy 
coupled. Farm managers 912 establish, wmfigitm and ™*frttmn VSPs 906 nn rmnpnting 
grid 904. According to one embodiment, each farm nssnaga 912 is assigned i sjasde 
VSF 906 to manage, however, farm managers 912 may also be assigned multiple VSFa 
906. Farm managers 912 do not communicate directly with each ofhir, bui only through 
their respective slave segment mana g ers 910. Slave segment managers 910 are 
responsiblo for monftoring the status of their assigned farm managers 912. Shrve segment 
managers 910 restart arxy of their assigned farm managers 912 mat have stalled or failed 
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lager 908 monitors the loading ofVSFs 906 and determines 
an amoanloficsoarwa to be allocated to eacbVSF906- Master segmen t man a gr 908 
then instructs clave segment rs uma gerj 910 to allocate nd do- allocate resources tor VSFs 
906 as appropriate mroogb farm minagers91Z A variety of load balancing algorithms 
may be impl emented dependi ng upon the rwpnremerrtB of a particular application and the 
inv entio n is not limit e d to any particular load balancing approach. 

platforms on which slave segment managers 910 and ft{ [ P managers 912 are executing to 
dota mtae whether cxjnrpntiDg god 904 is being adequately serviced. M a s te r segment 
manager 908 allocates and de-allocates clave segment managers 910 and instructs slave 
segment managers 910 to allocate and de-allocato farm managers 912 as n ec e ss ary to 
provide adequate m anagement of co mpetin g grid 904. According to one embodiment, 
master segment manager 903 also manages the assignment of VSFs to faro managers 912 
and the assignment of farm managers 912 to slave s egm e nt m a n a ge rs 910 as nec e ssary to 
balance the load a mon g farm managers 912 and slave segment managers 910. According 
to one embodiment, slave segment m a nagers 910 actively c ommun i cate with master 
segment man ager 908 and reques t changes to computing grid 904 and to request 
additiona l stave s egment mana g er s 910 and/or farm manag ers 912. If a processing 
platform fails on which one or more slave segment managers 910 and one or more farm 
s 912 are executing, then master segment manager 908 reassigns the VSFs 906 
1 912 on the feflod computing platform to other farm managers 
912. In this sjtnatwn, roaster segnen t manager 90S may also instruct slave s egm e nt 

manager* 910 to initiate ftAtitinttal fiirm managers 912 to t""wHw fH<» reassignment ftf • 

VSFs 906. Actively m an ag ing the nnrnber of cenyutatiooal resources allocated to VSFs 
906, me rannber of active farm managers 912 end slmx segment managers 910 allows 
overall power coftsumption to be controlled For example, to conserve power master 
segment manager 908 may shutdown computing platforms that have no active slave 
segment mangers 910 or fenn managen 912. Tbcpowet savings can be significant with 
Urge c outpu t in g grids 904 and control planes 902. 

segment managers 910 using a registry. The registry contains information about current 



assigned VSFs 906. As slave segmem managers 910 are allocated and deallocated, the 
registry is updated to reflect the change in slave segment managers 910. For example, 
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when anew slave aegmarf managw Q?n instantiated hy master segmwrt manager 90S 
cod assigned one or more VSFs 906, (ho registry is updated to reflect tibc crcadanof tbs 
new &i»vc segment mzmgrr 910 dd ita assigned farm nmnagm 912 ard VSFs 906. 
Master atyment manager 908 may ftw pmrrftrany wim^ rh* rcSftry to rif * wrp " 
bow to best assign VSFs 906 to slave segment managers 910. 

According to one embodiment, flic registry contain! information about mi*^ 

b910. For example, 
' segment manager 

manager 910 may diecfc the rtgist^ 
segment managers 90S. 

The registry may be anptooected in many forms and the mvenifon is out limited 
to ay particular implementation. For example, the registry may be a data file stored oa a 
database 914 wiftrin control plane 902. The registry may instead be stored onlsids of 
control plane 902. For example, the registry may be stored on a storage device in 
co mp e tin g grid 904. In (his example, the storage device wonld bo dedicated to control 
plana 902 and not allocated to VSFa 906. 

2. Master Segment Manager Election 

m general, a master segment manager is elected when a control plane is 
estabfished or after a faflnre of an existing master segment manager. Although (hero is 
tuiu. «Uy a single master Kgment manager for a particular control plane, there may be 
rituatmns where it is advantageous to elect two or moro master segment-managers to co- 
manage the da vc segment managers in the control plane. 

According to one embodiment, slave segment managers in a control piano elect a 
masrrr segment manager for mat control phne. hi the mmple case where there is no 
master segment manager and only a single slave augment manager, then the alave 
icgment manager becomes the master segment manager and nTVimti^ addition al slave 
segment managers as needed. If there are two or more ikvc segment managers, (hen the 
two or moro ilave processes elect a new master segment manager by vote, e.g^ by a 
quorum. 

Since slave segment managers in a control plane are not necessarily persistent, 
pardcnlar slave segmerrt mans Fcrcaample, 
according to one embodiment, the register mchnfes a timestamp for each slave segment 
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to specified selection criteria are most likely to sfiD be ex ec u t ing and are selected to vote 
for e new master segment manager. For example, a specified number of the most recent 
tlxvo teg 1 ! w it Tr**"*^^** m«y he selected fixr a vote. 

active slave tegmcnt man ag e rs sod > new master segment mam g rx ta determined based 

(he lowest or highest election sequence number may bo used to select a particular slave 
segment manager to be the next (or first) pasta segment manager. 

r to dttemmw whether me master segment manager bitffl active. Ifa 

x is no longer active, moo a 




PIG. 10 depicts a state diagram 1000 of a master segment manager election 

loop, the slave segment manager waits tor the eApuatton of a ping taper. Upon expiration 
of the ping tuner, state 1004 is entered, m state 1004, the slave seg m ent manager pings 
the master segment managec Also in state 1004, nmestamp (TS) for the slave segment 

segment manager is still active end control returns to state 1002. If no response is 
received from the m^fl^r segment manager after a specified period of time, then stale 
1006 is entered. 

Id itite 1 006, an stfivo slave segment numiger bst u obtained end. control 
proceeds to state 1008. fa rfiis 1 005, ■ check is mado to determine whether other ahvo 
s eg me nt mamgeis have also not received a response from the mister segment manager. 
I nste ad of sending messages to slave segment managers to mate mis deteenjaagon, this 
mfinmahonmsy be obtained ftnm a database. If me slave segment managers do not 
agree that master se gm en t m anage r is no longer active, ie^ one or more of me slave 
tf ^ i iirm i managers received a timely response from the master segment manager, then it is 

s stifle 

3 1002. Ifasj 
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□ the caned master cfgrfttt manager, then it is assumed thai the 
enrrent master segment manager is "dead", Lc, no longer active, and control proceeds to 
state 1010. 

Id state 1010, me alive segment manager mat initiated to proceoiBtiisvoa 
roxrent dectkro mnnba - from sn election table sod the next election number from a 



Control then proceeds to state 1012 where me slave segmem tnsnager reads the lowest 
a. in state 1014, a determination is made 
. If sot. 

then control retrnna to state 1001 If so, men control tsocceds to state 1016 where the 
particular slave segment manager becomes the master segment manager. Control men 
proceeds to state 1018 where the election anmher is meremegted. 

As described above, slave se gment managers are gpymDy responsible frr 
servicing their assigned VSFs and allocating new VSPs in response to instructions from 
. Slaves 



no. llisastateo^aaamllOOmstflhistiatM 
lager sccwding to en embodiment. P rocess in g starts in a stave segment manager start 
&U02. From state 1 102, ccaitro) proceeds to stats 1104 m response to amplest to 




r is still active. If a timely response is received from the 
; the control proceeds to state 11 06. to state 1106. a 
message is broadcast to other slave segment maimgers to mdicEte that the rnastcr segmail 
manager responded to the ping. Prom state 1106, control returns to start stale 11 02. 

In state 1 1 04 if no timely master response is recdved, then control proceeds to 
state 1108. Id state U 08, a message is broadcast to other slave segment managers to 
indicate that the master segment manager did not respond to the ping. Control then 
retorns to start state 1102. Note that if a surncient number of slave segment managers do 
not receive a response from 13 
segment manager is elected as described herein. 
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From start state 1102, control proceeds to state 11 10 upon receipt of a request 
frrmi the oiaster segment inanagcr to restart a VSF. m state 1110, oVSFb restarted sad 
control returns to start state 1 102. 

As described above* a coster segment manager is giaexiHy responsible for 
ensmmg mat VSFs m the { on i p **ty Tft g grid controlled by tile master segment manager arc 
adequately saviccU by one or more stave tcguioit managers. To accomplish this, the 
pasta fq pp wt o aanag ei pe rfbnpj le gttfar healfh checka on all slave segment managers in 
Ht^ pmo control plane as fta master segment manager . Af cor d ^g to one ffntbodim^fj 
master snguiflnt manager 903 periodically re qu est! status information from slave segment 
managers 910. The information may include, for example, which VSFb 906 are being 
serviced by slave segment man a g er s 910. Ifaparocnlar slave segment manager 910 does 
not respond in a specified period of time, master segment manager 908 attempts to restart 
the paittcnlar stove segment manager 910. If die particular slave segment manager 910 
cannot be restarted, men master s e gment manager 90S re-assigns fee farm mana g ers 912 
from me failed slave segment manager 91 0 to another slave segmert manager 910. 
Master segment ma nager 908 may then instantiate one or mote addmnnal slave segment 

segment managers 910 are executing. If i computing platform finis, then master segment 
manager 908 reassigns the VSFs assigned to farm manager s 912 on the failed competing 
platform to farm managers 912 on another txunputing platfmmj. 

FIG. 12 is a state diagram 1200 for a master segment manager. Processing starts 
in a master segment manager start state 1202. From stale 1202, control proceed! to state 
1204 when master segment manager 908 makes a periodic health check or request to 
alave segment managers 910 in control plane 902. From state 1204, if all slave segment 
m n n *tT t v OlOTf^pftT 1 ^ CTp^rfwH > ftfn f^TTffr^l r ^ Tt mf t 1 * c ^*^ p i^flft This occuis if all 
slave segment managers 910 provide the specified infm mutton to master segment 
manager 908, mdicahng mat all slave segment managers 910 are operating normally. If 
one or more these s egme n t man a ge rs 910 either don't respond, or the response otherwise 
indicates mat one or more slave tf.giuf nt managers 910 have failed , men control proceeds 
to state 1206. 

bi state 1206, master segmem manager 908 
segment managers 9 10. This may be accomplished in several ways. For example, master 
segment manager 908 may send a restart message to a non-responsive or failed slave 



-24- 



(65) 



JP 2004-508616 A 2004. 3. 18 



wo 02*3203 rcr/nsoi/msj 
segment nnmager 910. From state 1206, if «Hb1jvc segment manages 910 responds* 

<np« Jwt i * t K^Yff ***f1 r* il ^■fi'Hy rT^^T*^, ft>«-n «ailn'»l rrimn* ttt gfwfn 12fYt POT 

example, when • failed slave segment manager 910 is snciwafhlly restarted^ tho slave 

908. From state 1206, if one or mars slave segment managers have not been snccessfhOy 
restarted, then control proceeds to state 1208. Thii otgatjon may occur if m i st e r s egment 
manager 908 does not receive a restart confirmation message from a particular slave 
segment manager 910. 

fa state 1208, master segment manager 908 determines the enrxect loading of the 
mftfJ i mw on wLidi slave segment manager s 910 are executing. To obtain the slave 
Mo ment rruti 908 loading information, master segrncrrt m a n a g er 908 polls slave 
se^iinil managers 910 directly or obtains (be loading information from another location, 
for example from database 914. The Inv e nti on is not Hnritcd to any particular approach 
for master segment manager 908 to obtain foe loading mformalian for slave segment 
managers 910. 

Control men proceeds to state 1210 where the Y^s 906 assigned to me railed 
slave segment managen 910 are le-attagrmri tn frfhw »kve «ygrrtrfrt trnm»grff Q]t) The 
slave segment managers 910 to which the VSFs 906 are assigned inform master segment 
manager 908 when the reassignment has been completed. For example, slave segment 
pi^m^^fl 910 iDfly fffpd ft e^a^t f^* 1 1 1 is* i it <7^i tfi 1 1 mtrinn mcsso^o to jnsstcx segment 
manager 908 to indicate that the reassignment ofVSFs 906 has been successfully 
completed Control remains in stale 1210 until reassignment of all VSFa 906 associated 
with the railed slave segment managcri 9 10 has hem confirmed. Once confirmed, 
control returns to state 1202. 

Instead of reassigning VSFa 906 associated with a failed slave segment manager 
910 to other active slave segment managers 910, inaster segment marjager 908 msy 
allocate additional slave segment managen 910 and then assign those VSFs 906 to the 
new slave segment managcra 91 0. The choice of whether to reassign VSFs 906 to 
existing slave segmem manager* 910cr to r»w slave s^mem managers 910 cfopends, at 
least in part, on latencies associated with allocating new slave segment manager* 910 and 
latencies *«nri»tnrt win reassigning vsp* on* tn an Bering acgrncnt manager 
910. Either approach may be osed depczidrng upon the teqmrgncnts of aparticnlar 
Bp pJScat iQn snd the isvenhnn is not limited to cither approach. 
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3. ^Amim&i attv^ Functions 

According to one **n*w*Tm*Tft, control plane 902 U cocnmnmccthrdy coupled to a 
global grid manager. Control plane 902 provides bill"^ fault, capacity, Tnawfrng and 
other ccmptttrnggn^hifhTTTtftion to the global grid manager. FIG. 13 is a block diagram 
1 3Q0 feat fl hgo alDa the ma of * global grid manager sccoriiDg to m ons bodiDicnt 

In FIG- 13, acooptitog grid 13C0 is putitkracd inio logical pottiffin called grid 
segments 1302. Each grid segment 1302 mclndea a control place 902 that control* and 
manages a data plane 904. In this r wpVi each data plane 904 is the nme at the 
cmrrmtrrrg grid 904 of FIO. 9, but are referred to as "data planea* to iHnatratB the csc of a 
global grid manager to manage multiple control planes 902 and data pl an e s 904, ia, grid 
segments 1302. 

Each grid segment is conimnoicativery coupled to a global grid managa 1304. 
Global grid manager 1304, control planes 902 and computing grids 904 may be co- 
Located cm a single computing ptatfbnn or may bo distributed across m u lt i pl e computing 
platforms and the invention La not limited to any particular mmlementattan. 

Global grid manager 1304 provides c*naiihzed management and cervices for any 
number of grid aegmenta 1302. Global grid manager 1304 may collect billmg, ksading 
and other mlmmation from control planes 902 used in a v ari ety of administrative tasks. 
For example, the billing mfbnnattoo is used to bill for services provided by computing 
grids 904. 

4. Policy and Security C arta dfl taricm 

As d e w j ib ed herein, a slave argnirot Trmnagfj in a control plane must be able to . 
ccrnrrrnnicate with its assigned VSFs in a oonrpoting grid. Sinrilarty, VSFa in a 
ccrrrrmtmg grid must be able to oomnrurrkato with their assigned alave aegmrnt manager. 
Further, VSFa in a competing grid must not be allowed to ccanminncate with each other 

VSP. Various Bppzoaches far implementing these policies are described hereinafter. 

HG. 14 is a blocs, diagram 1400 of an Brrhirrrtrrrc for <acrmfrting a control plane 
to a comparing grid e«oardmg to an embodiment Control ("CIV) parts of VLAN 
switches (VLAN SW1 through VLAN SWn\ collectively identified by reference numeral 
1402, and SAN switches (SAN SW1 through SAN SWn), collectively identified by 
reference nirrneral 1404, are connected to an Ethernet subnet 1406. E&emet subnet 1406 
is co nn ected to a plurality of computing elanentl (CPU1, CPU2 through CPUn), that are 
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coflectivtily identified by reference 



1403* Thus, oury ifliiit pt^hrt^ ehznents of 



control plane 1408 ere tun iinnutkili rely oou y lcd to the control ports (CTL) of VLAN 
twitches 1402 and SAN twitches 1404. This ctrnfigmzfirm prevents conipuu^ elements 
to » VSP (tjot illustrated), Hum c hanging the m emb ership of the VLANs gad SAN zones 
associated with itself or my other VSF. This approach is also applicable to sitnariona 
where the control potts tre serial or parallel ports. In these situations, the porta iro 
coupled to the control pbtoe 1408 computing dements. 

FIG. IS is a block diagram 1500 of a configuration for oonn cct n tg control plane 
carnpnting dementi (CP CPU1, CP CTIQ through CP CPUn) 1502 to (iala ports 
according to sn embodiment, hi tins configuration, control plane computing ricmeuts 
502 periodically send a packet to a control pha» agem 1504 tliat acts on behalf of cmitrol 
plane computing elements 1502. Control plane agent 1504 periodically polls computing 
elements 502 for real-time data and sends the data to control plane ccmpcting riemmrw 
1502. Each segment manager in control plane 1502 is cc amnuui cafivdy oocpled to a 
control plane (CP) LAN 1 506. CP LAN 1506 is ccmrmmicativtry caroled to&special 
port V17 of VLAN Switch 504 through a CP firewall 1508. This configrmcion provides 
a scalable and secure means for control plane computing elements 1502 to co licet reaj- 

FIO. 16 is 8 block diagram 1600 of an architecture for connecting a control plane 

plane computing elements CP CPUl, CP CPU2 through CP CPUn. Bach control plane 
c ompu ti n g element CP CPU1 , CT CPU2 through CP CPUn in control plane 1602 is 
communicatively coupled to a port SI, S2 through Sn of a plurality of SAN switches that 
collectively form a SAN mesh 1604. 

SAN mesh 1604 memdes SAN ports So, Sp that are cermnunicafivcry coupled to 
storage devices 1606 that contain data mat is private to control plane 1602. Storage 
devices 1 606 ore drpictrd in FIG. 16 as disks far purposes of exploration. Storage 
devices 1 606 may be implaneiilwi by any type of storage modiim and the invenhon is 
not tnnited to any particular type of storage coecticm for storage deriocs 1 606. Storage 
devices 1606 are logically located in a control plane private storage zone 1608. Control 
plane private storage zone 1608 is an area where control plane 1602 maintains tog files, 
statistical data, current control plane configuration iiifiwijintion and software that . 
implements control plane 1602. SAN ports So, Sp are only part of the control plane 
private storage zone and are never plsced on airy otfter SAN zone go that onfy 
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rfw^wit* qj control plane 1602 qq acc e ss the H u mg e devices 1606. Furthermore, ports 
Si, S2 through Sn, So and Sp ate is t control plans SAN zone tint may only be 
fcfamiHiiuutivdy coup le d to computing elements in control pbtne 1602. These ports are 

CP GPU2 through CP CPUn needs to access a storage device, or t portion thereof fbsi is 
part oft particular VSF, the particular computing dement is placed into die SAN zone for 
fly. jnrr t|fat^ VSF. For c amp l e, s npp o sc thsl c omp tilin g *f"'wi l CP CPU 2 needs to 
access VSFi disks 1610. fa this situation, port s2, which is nsoasted with control plane 
CP CPU 2, is placed in me SAN xaoc of VSFi, which includes port Si. Once computing 
dement CP CPU2 is done accessing the VSFi disks 1610 on pert Si. computing dement 
CP CPU2 is removed from Ac SAN zone of VSFi. 

Similarly, suppose computing dement CP CPU 1 needs to iccess VSFj disks 
1612. In this shnszion, ccnniutmg elem 

associated with VSFj. Ass result, port SI is placed in the SAN zone associated with 
VSFj, which includes the zone containing port Sj. Once computing demon CP CPU1 is 
deco accessing the VSFj disks 1612 connected to port Sj, computing dement CP CPU1 is 
removed from (he SAN zone associated with VSF). Una approach ensures the integrity 

As previously descri bed, a single control plane computing HfirtfJit may ho 
r esponsible Cot m a n ag in g several VSFa. Accordingly, a single control plane computing 
element must bo capable of manifesting itsdf in inn triple VSFs simultaneously, while 
enfeccing fhrwallrag bet w een iho VSFb according to policy rulcj established for each 
control plane. Policy rules may be stored in database 914 (FIG. 9) of each control pfenc 
or i mpl e m en t ed by central segment manager 1302 (FIQ. 13). 

ABCcsdrstg to one enibodhnent, tight binding between VLAN tagging and IP 
addresses are used to prevent spoofing att ac ks by a VSF smco (physical switch) port* 
based VLAN tags are not spoofabie. An mcornmg IP packet on a given VLAN interface 
must have fee same VLAN tag and IP address as &e logical interface on which the packet 
arrives. This prevents IP spoofing a ttacks where a malicious server in a VSF spools the 
scarce IP address of a server in another VSF and potentially modifies the logical structure 
of another VSF or otherwise subverts the security of computing grid functions. 
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CUvAUii v tilling (hit VLAN tigging approach requires physical access to &ecuciputxng 
grid which can bo prevented using high security (Class A) d ata centers. 

A variety of cgtwort frame togging formats may be used to tag data pyArta and 

embodiment, EBB 802.1q VLAN tags are used, although other formats may also be 
lettable, fa this example, a VLAN/IP address consistency chock is perforata! at a 
subsystem in me IP stack where 802. lq tag information U present to ccmrol access. Id 
mis example, co mp utin g dements arc configured with a VLAN capable network interface 
card (NIC) in a maimer that iDowi the computing dements to be oonininpicatrycly 
coup le d to multiple VlANs snnnHaneoasty. 

FK3. 17 is a block diagram I70O of an arrangement for amercing ti^xt binding 
between VLAN tags and IP addresses accenting to an embodiment Computing dementa 
1702 and 1704 arc commnnicatrvtJy conpkd to porta viand v2 of a VIAN switch 1706 
via NICs 1708 and 1710, respectively. VLAN awitch 1706 ia also amummkstively 
coupled to access switches 17 12 and 1714. Ports vl andv2 are configured in tagged 
mode. According Co one embodnuem, IEEB 802.1 q VLAN tag infbimatumu provided 
by VLAN switch 1706. 

A WIDB AREA O0MPUTINO GRID 

The VSF described above can be distributed over a WAN in several ways. 

hi one alternative, a wids area, backbone miy be based on Asynchronous Transfer 
Mode (ATM) switching. Id this case, each local area VLAN is extended into a wide area 
using Emulated LANs (ELANs) which are part of the ATM LAN Emulation (LANE) 
standard. In this way, a single VSP can span across several wide area links, such as 
ATM/SONET/OC- 12 links. An HAN becomes part of a VLAN which extends across 
fee ATM WAN. 

Alternatively, a VSF is extended across a WAN using a VPN system. In this 
embc<iimenl, the underlying characteristics of the network become irreipvani, and too 
VPN ia uaed to interconnect twn mmoro VSFs across the WAN to make a single 
distributed VSF. 

Data mhroring te c hno logies can be used in order to have local copies of the data 
in a distributed VSF. Alternatively, the SAN is bridged over the WAN nsing one of 
several SAN to WAN bridging techniques, such as SAN-to-ATM bridging or SAN-to- 
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Gigsbit Ethernet bridging. SAHs constructed over IP networks tataaSy extend ovg the 
WAN since IP works well over snch networks. 

FIG. 18 is* block diagram of a pbraSty of VSFi attended over WAN 
ormnncrirm A San Jose Center, New York Center, and Unden center •» corded by 
WANoomttctiona, Each WAN connection oocipiiies an ATM, ELAN, or VPN 

wmwtinn tit tfw! mftnrvr \hrA gtwrve. Each Caiia C O m pn S C I Bt least OPO VSF and at 

least one EdbPooL For example, the San Jose center has VSF1 A and Idle Pool A. Into* 

allocation or assigt uncut to a VSF locatrd in any o&cr i tn ta . When such aOocztton or 
wmgnntont is ramcd out, a VSF becomes e x te n ded over the WAN. 

EXAMPLE USES OP VSFS 

The VSF architecture described in the examples above may be used in the context 
of Web sorer system. Thus, die foregoing examples have been described in tenns of 
Web servers, appl ic a t i o n servers and da tab ase servers constructed out of die CPUs in a 
particular VSF. Howevci, the VSF architecture maybe osed in many other computing 
contexts and to provide other kinds of services; it is not bruited to Web server systems. 

- A DISTRIBUTED VSF AS PART OF A CONTENT DISTRIBUTION 
NETWORK 

fa one embodiment, a VSF provides a Content Distribution Network (CDN) using ■ 
a wide area VSF. The CDN 13 a network of cac hin g servers that performs distributed 
caching of data. The network of c a ch ing servers rosy be rm pVun- j it rd, for e x a mp le, using 
TrafficServer (TS) software ccnnncrciaUy available from fnMiitiii Gupta anon, San 
Mateo, California. TS is s clustn iiwtrt system; the system scales as more UfUi are 
added to a set of caching Traffic Server computing elements. Accordingly, it is well 
sorted to s system in which sdding CPUs is the mechanism ox scaling upwards. 

In this configuration, a system can dynamically add more CPUs to that portion of 
a VKF thst reus caching so ftwa re toch as TS, thereby growing the cache opacity at a 
point close to where bursty Web traffio is occurring. As a result, a CDN may be 
constructed that dynsmi cally scales in CPU and I/O bandwidfti in sn adaptive way. 
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Resource Planning (ERPX ORM and CRM software as basted and managed serviccs. 
Technologies such es Gtris WmFnnnc sod Qtrii MetaFrnme bDow m fl n fr f p"** 1 to 
provide Microsoft Windows ipplicat j qns is i acrvice on a flrin chenl nich as a Windows 
CE devke or Web browser. A VSF can host sncb applications in a scalable manner. 

For example, fhe SAP R/3 ERP software, commercially available from SAP 
AktirrTgrerJltubaft of Germany, altowa an enteipaso to toad balance using multiple 
Application and Database Servers. In the case of a VSF, an enlerpriso would dynamically 
add more Application Servers (e.g, SAP Dialog Servers) to a VSF in order to scale op the 
VSF baaed oo rtaKimc demand cr other factors. 

Similarty, Otrix Mctaframo allows an enterprise to scale up Windows apphcaiion 
men on a server farm running the hosted Windows appliraTrrms by adding more Qtrrx - 
servers. In Una case, for a VSF. the Orrrix MctaFrtmc VSF would dynamically add more 
Gtrix servers in order to accommodate more users of Metaftrme hosted Windows 

apphcations. B XtiM be «ppgrrrrt that fnarry <?fS»r ftppbryhTf may behostcd ID f mgrrrvr 

similar to the illustrative examples ^n y ^n y 'd above. 

- CUSTOMER INTERACTION WTTH A VSF 

Since a VSF is created on demand, a VSF customer or orgarrizfltion that "owns" 
the VSF may interact with the system in various ways in order to customize a VSF. Far 
example, because a VSF is created and modified instantly via the control plane, the VSF 
enstonua may be granted pri^ The 
privileged access may be prov^ 

and sccrmry appUcatkma, token card nnthmtirntioo, Kerbcroa exchange, or other 
appropriate security elements. 

m one excmplHry embodiment, a Get of Web page* are saved by tie ccii^jutmg 
elemem\c«- by a separate server. The Web pages enable a customer to create a custom 
VSF. by specifying a number of hers, the nrrrpbar of computing dm™** m » p»rt^nf^r 
tier, the hardware and software platform used tor each dement, and things such as what 
kind of Web server, application server, or database server software should be pre- 
configured on these computing elements. Thus, the customer is provided with a virtual 
provisioning console. 
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b an an m anaga t to cobtfp thai they are app r opri ate, CnBt checks of the eolapdsBiniy 
be ran to ensure &2t tt has approbate cmdit to pay for the requested services. If the 
provirionmg order b approved, foe control plane may configure a VSF flat i mlU t a flie 

OXdCT, tod | > tr> the Cflf t r " I ^ * jMWKHwnfri pmvid] ng root &OOCSS to OQO OT ITTwi c of &C 

upphcjilitm to execute in the VSF. 

When the enterprise that boats the co m pe t i n g grid is a for-profit enterprise, the 
Web pages may also receive payment relaledmlbTinstkin, taehes icrerfUca^ iPO 
number, electronic chncay or other payment method. 

b another embodiment, die Web pages enable (he customer to choose one of 
several VSF service plans, soch as automatic growth and shrinkage of a VSP between a 
rmnTTTTTTfTf s o d psjon roM pnmbc f of d ci aen bL bawd oo real-time loadL 7na customs 
may have s control valne mat allows the customer to change parsmetere toch as mnrimmn 
number of computing elements in a particular tier each ss Web servers, or a time period 
in wmch (he VSF most have a minimal amount of server capacity. The pi u ai mia s may 
be hhkod to billing software that would mrtomaticaDy adjust the customer's bill rate and 



Through the privileged access mec h an i sm the c ustomer can obtam teports sad 
monitor real-time information related to usage, load, hits or UmpAcaons per second, md 



approaches to constructing a server farm, b the conventional approaches, a aser cannot 
automatically influence server nam's properties without going through a cumbersome 
manual prooednre of adding servers and con figuring the server farm in various ways. 

- BILLING MODELS FOR A VSF 

Given foe dynamic nature of a VSF, foe enterprise that hosts foe co m p ut ing grid 
and VSFi may bill service fees to customers who own VSPs using a billing model for a 
VSF which is based on actual usage of foe computing elements and storage of a 

VSF. It is not necessary to ose a flat foe biflmgmodeL The VSF architecture and 
methods disclose d herein enable a "pay-as-yoo-go" billing model because foe resources 
of a given VSF are not statically assigned. Accordingly, a particular customer having a 



p* TE Ht tnrt fYa hrntfff fo^ ot^t gpfl gp*wn ft frf ttji+rrtwi 1 Orders may be reviewed by 



adjust foe characteristics of a VSF based 
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highly variable usage load on its serv er farm could cave money because it would not bo 
tailed a rite essociilrd with cctuJim pak arrm capacity, but rather, a rate That reflects a 
iijj.niiig aveifige of usages iriitfliifpnffff'Tff psag^ em. 

For example, an e nterp rise may operate using a billing modd that stipulates a flat 
fee fiar a minimum mrniWof wtmjrrftng rinuwit^ t"*^ as 10 servers, sod stipulates that 
when real-time load requires more than 10 *t"n < Trti. Own the user b billed at aa 
incremental rate for the extra servers, based en how many extra terras were needed and 
fir the lengfo of time that they are needed. The units of lachbiflj may reflect (he 
resources fltsi are billed. For example, bills may be expressed in rants such as MIPS- 
houra, CTU-houra, thousands of CPU seconds, eto. 

- A CUSTOMER VISIBLB CONTROL PLANB API 

m another alternative, the capacity of a VSF may bo controlled by providing the 
easterner with an application programming interface (API) thai defines calls to the control 
plane for changing resonrees. Thn^ an gppheation program prepared >*y the cnyfryrwr 
could issue calls or requests using flu API to ask for more server* incte stc<sg* more 
bandwidth, etc. This alternative may be used when the customer needs the application 
program to be aware of Qio computing grid eavTnnnnenl rod to tain advantage of toe 
capa bfl itie a offered by the control plane. 

Nothing in tor above-disclosed architecture requires the customer to modify its 
application for use with the compe rin g grid. Existing applications coctimie to work aa 
they do in manually configured server hums. However, an application can take 
tdvuntago of the dynamism possible in the competing grid, if it has a better understanding 
of the computing resources it needs baaed on the real-time load monitoring functiona 
provided by the control plane, An API of the foregoing nature, which enables an 
application program to change the cmnputing capacity of a server farm, is cot possible 
lamigexu^ manual approaches to 

- AUTOMATIC UPDATING AND VERSIONING 

Using the methods and mechanisms disclosed herein, the control plane may cany 
oat aut om atic updating and vcmnmng of operating system software that is accented in 
competing elements of a VSF. Thua, the end user or easterner u not required to worry 
about m^athnj the cperatm^ The control plane can 
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DBMBtefn a Ebtny of such software elements as (hey are received and HUtomattcally 

IMPLEMENTATION MECHANISMS 

The cornputmg eternals end control plane may be implemented in seven! faults 
and flic invention is not hauled to any particular farm. In one embodiment, e ach 

FTQ. 19 except for nan-volatile storage device 191 0, and (he control plane b s general 
purpose digital computer of (he typo shown in FIG. 19 operating under control of 
program instructions thai implement (he processes described herein. 

Figure 19 is a block diagram fhst illustrates a computer system 1900 upon winch 
an embodiment of the invention may be tepjernented. Computer system 1900 includes a 
bus t902 at other oomrrrnmoirion mechanism far cc*rmumrratrng nrfhrmarinn. and a 
processor 1904 ooepled wifli bos 1908 far pro cessing fntVirni atiraL Computer system 
1 900 also includes a raaiD memory 1 906, such ai ■ random acceu memory (RAM) or 
other dynamic storage device, coupled to bos 1902 for storing information and 
instruction! to bo exe c ut ed by p ro c es sor 1904, Main memory 1906 also may be used far 
storing temporary variables or other mtnrnediats u i fb ii nation dinin g execution of 
instructions to be executed by processor 1904. Computer system 1900 farther m c rnde a a 
read only memory (ROM) 1908 or other static storage device coupled to bus 1902 far 
stormg static infftrmwf km and hmrootioos far processor 1904. A storage device 1910, 
such as a magneti c disk or optical disk, is provided and coupled to bus 1902 for storing 
information and instructions. 

Computer system 1900 may be coupled via bm 1902 to a display 1912, such as a 
cathode ray tube (CRT), far displaying information to a computer user. An input device 
1914, mchx&ng alphanumeric and other keys, is coupled to bus 1902 for communicating 
infbnnation and command selections to processor 1904. Another type of user input 
device is cursor control 1916, such as a moose, a trackball, or cursor direction keys for 
oonwvmtK sating direction information and command selections to processor 1904 and for 
corrtroffiri£ curxcr movcrseat on display 1 91 2. This input device typically hts two 
degrees of freedom in two axes, a first axis (eg, x) and a second axis (e.g, y), feat allows 
the device to specify positions ma plane. 

The invention is related to the use of computer system 1900 for controlling an 
extensible competing system. According to one embodiment of the Lnventtoo, controlling 
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sii extensible competing system is provided by computer system 1900 in response to 
processor 1904 accoting one or more sequences of arte ot more mstractjuns ocrttamcd in 
numrnnnory 1906. SudimstroctkHisrnayberead 

crnnrwitrr -readable medium, such as storage device 1910. Execution of (he sequences of 
instruction* contained in main memoiy 1906 cans^ processes 1904 to pa£nmfl» 
process steps described herem. One or more processors m » nBrifry o ecas i n t j 
anarfeHuwrtmay ahobeermplc^ to 

main memory 1906. Id slhrnati ve cmbcxrimeais, herd-wired crrcurhy may be used in 
Place of or in comhrmrtkm wim eoftware mufrortinmi tn implmw^t hr^Tttioa Thus, 
embodiments of the invention are not limited to any specific combination of hardware 
errantry and software. 

The tenn *\xnnputor-readable medium" as csed herein refers to airy medinm thai 
participates in providing instructions to processor 1904 fix execution. Such a medium 
may take many forms, including bet cot Hrnrtcd to, non-volatile media, volatile media, 
and transmissio n media. Non-volatile media inclodea, far example, optical or magnetic 
disks, such as storage device 1910 Volatile media includes dynamic memory, sach as 
main memory 1906. Transmission media jnclndes coaxial cables, copper wire and fiber 
optica, including the wires that comprise bus 1 902. Transmission media cm also take the 
farm af acoustic or light waves, such as those generated during radio wave and hafrerod 
data oobb ni1 'ftVtiTtfffl t 

Common forms of computer-readable media include, tor example, a floppy disk, a 
flexible disk, hard disk, magcetjo tape, or any other magnetic medimn, a CD-ROM, any 
other ojrticrd medium 

of holes, i RAM, ft PROM, and BPROM, a FLASH-EPROM, any other menxay chip or 
cartridge, a carrier wive as described hereinafter, or Eiry other medium fhxn which n 

• Varies tbnris of corarmtexread^ 
more recpences of one oi more instructions to processor 1 904 for execution. For 
o r amp l e, the instructions may rmtjftfly be carried tm a magnetic diakofa nanote • 
computer. The remote computer can load the instructions into its dynamic memory and 
send the instructions over a telephone Hue using a modem. A modem local to compute 
system 1900 can receive the data on the telephone line and use an infrared transmitter to 
convert too data to «n infrared signaL An mfrared detector coupled to bus 1902 can 
receive the data carried in the infrared signal and place the data an bus 1902. Bus 1902 
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carries (ho data to main memory 1906, from winch processor 1904 ictrieves and exeartcs 
the instructions. The instrnctkais recast 

■tend cm storage device 1910 either before or after aeration by pneessor 1904. 

Computer system 1900 abo mcmdea acc cmmmc s ti on interface 1918 coupled to 
baM 1902. OwTTrrtTTrTTfattioo mterfaoo 1918 provides a two-way data coTTHTiTTTTiratinn 
coupling to >cctwcrk fink 1 ffr»t i» rrrrmrr&rA tn * InraH nrfwimk For example, 
cnrvinirnitcatinTi uflufato 1918 maybe an integrated services <Bgtei network (ISDN) card 
or a m odem to provide a data cmmmu ncatlo a w mirc t i oa to a u m e s jtooihng type of 
telffpboccfanet As another muiipfa, onua ui mrfrfifH M t Hi[j*fiki6 1918 mty be a local area 
network (LAN) ctrd to provide a data cow nmrrif anon cxsbmcooh to a compatible LAN. 

inte rface 1918 sends and receives elec trical , electrom agneti c or optical signals that cany 

Network Eat 1920 typically provides data communication through one or mere 
networks to other data devices. Fox example, network Imk 1920 may provide a 
connection through local network 1922 to a host competes 1924 or to data ecprpment 
operated by cn Internet Service Provider (ISP) 1926. BP 1926 m torn provides data 
aa nmu a icstton . set vices through the worldwide packet data cemmmncatioo lastworfc n ow 
commonly referred to hj tho TnteW 1923. Local network 1922 nod Internet 1928 bom 
use electri c al electro ma g n etic or optical signals that carry digital data streams. The 
signals through the various networks and the signals on network Imk 1920 and through 
cotnTmnttCstfon fajjerfaos 1918, which cany the digital data to and from ccanpctci system 
1900, are exemplary forms of carrier waves transporting the information. 

Computer system 1900 can send messages and receive data, incl u ding program 
code, through the ndwodrfs), network Imk 1920 and ccgrmmnication mto race 1918. hi 
the Internet crample, a server 1930 might transmit a re qu es t ed code for an Application 
program through Intmrct 1928, ISP 1926, local network 1922 and cxmrnmmcanon 
interface 1918. In aoooriance with the invention , one such dow nl oa de d applic at ion 
provides tor controlling an extensible commuting system as described herein. 

The received code may be executed by proc«ss« 1904 as it is received, and/or 
stored in storage device 191 0, or other Doo-volatile storage fax Inter execution, maris 
manner, c o mpu te r system 1900 may obtain apphcation code in the form of a carrier wave. 

Hio ^nnputniffi fpyft wlcffpd hcr ff^ ecsnpflxed c j om?cpt\ ta ^^y ^ tttc public 

electric power network that ii sometimes called the power grid. The power grid provides 
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a scalable means for many parties to obtampowcx services tfaroa^i a ang^e wide-scale 
power in&astcoctnrB. Sinulad y, die ewn pat in fl grid disclosed herein provides coanpotm g 
services tn organizations mtig * sin g le wHiinaRale c om p e tin g hflastroctcre Using 
ftepoTOgrid^powCTConsnn^donotmdep 

equ ip ment For example, there is no reason for a utility consumer to run a personal power 
generator it ia facility, or in a [tared facility end manage its capacity end growth on an 
mdmdnal basis. Instead; the power grid enables the iride«ate£xtiibatiooofpowcrto 
vast segments of fittpcpulitiaa, ther*^ Similarly, 
the computing grid disclosed herein can provide competing services to vast w: ginnrfi of 
the pcqjajlation rating a tingle wide-scale computing infrastroctare. 

In the foregoing Epcciftcaiion, the mvention h2s been described with refers to 
specific anbodimenti raereoC It wiQ, however, be evident that virions modifications ind 
changes may be made (hereto wiJboul &Bfiu1^tmi1b»lmK^tslii&na$ooptotQ» 
invorbon. The spedficahon and drawings are, tccordingry, to be regarded in an 
illustrative rather than a restrictive sense. 
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Whjil is cliiroed uc 

1. A control apparatus coznpnsnig? 
> Bmte control pee h a msmi tod 

one or slave contiol n ^^^^ iynyfrn^ i* c^nm i nrny ^ f vnly coupled to ffao tihw^tf 

<sn TTtT5l WrhmTTm Wtg COCfigpred to, *w i»gpnn«» tn one or more 

mstrocriona ileus the master control mechanism, establish a first logical 
resource group that ccppmu 8 first subset of processing resources sod a 
first subset of storage resources byr 

selecting the first subset of processing resources from s set of processing 

resources, 
selecting the rhstsnbset of st^^ 

resources, end 

r Jil Btftg the first subset of processing resources to be comrmrmcatrvery 
coupled to (he first subset of storage resources. 

2. A control apparatus ss recited in Qnhn 1, wherein the mister control mechanism 

more sieve control m e ch an isms arc one ox more slave processes executing on the 
ooc os more processors. 

3. A control apparatus as recited in Claim 1, w h erei n the master control m e ch anism 
is one or more master processors and the one or more ilave control mechanisms 
arc oco or more slave processors. 

4. A control apparatus as recited in Qnim 1, wherein flto master cuutiul m cdmmam 
is configured to, based upon slave control process mechanism looding, 
dynamically reassign control, between the one or more slave control mectwiiikuis, 
of one or more processing resources from the cub set of processing resources aod 
one or more storage resources from the subset of storage resources. 

5. A control apparatus as recited in Claim L, wherein the master control mechanism 
is configured to, based upon slave control process mechanism loading, 
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djsiarjiicalrjp if f^Mft^ cmf. of more addrtaanal slave control mechanisms! and 
assign control of one Of moro processing resources from the subset of prccessnig 

reSOdCeS And OQC OT lllf 1 !^ Storage FT^H l [f ^S fi mii the SlllffEfft of Storage 

resources to the quo or a dd i ti onal stave coptf ol tpechjuii'giu. 



A control apparatus bs recited in Cfafm I, wherein Hie master control mechanism 
is co n figured to, based upon slave control process mechanism V^xf^g, 
i r^mug n control to one or more other slsve control "yVp 1 *^ from die ooc or 
more slave control nirr'Jiaiii.vrM of one or metre particular processing 
resources from die subset of processing resources end one or more 
particular storage resources from the subset of storage resoi 
previously assigned to one or more particular slsve control 
from the one or more slsve control mechanisms, and 



7. A control apparatus as recited in Oarm 1, wherein Che master control rK"tipmrn 
is configured to: 

determine a status of the one or more slave control mechanisms, 
if one or mora particular slave control rffe chanim v* from the one crmcTB slave 
control mechanisms are not i«^iondiug or frmcliomng correctly, then 
stleznpting to restart the one or more reticular slave control mechanisms, 



if the one or more particular slave c 



xdmechffl 



reassigning control of processing resom 

D ow the one or more particular slave control "reh? 
to the one or more new slave control mechanisms. 



8. A control apparatus as recited in Claim 1, wherein the one or more slave- control 
determine a status of the master control mechanism, and 
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if the master control n i^Tih a P tfiyy * has fatiy*^ or is do lopsjB r fijpctioofflg property, 
elect 8 new pastel cont rol mechanism fiuw the cob or man dm control 

9. A control ippmtai 88 tocttcd in Chum 1, wherein fee out or laoninstnictiana 
from fee roaster ouutiol mechmsDi are generated based upon expected processing 
tod storage rcqmremcnts fig fee first logical resource groan*. 

10. A control apparatus n recited in Claim 1, wherein fee one ox more slave control 
mechamams sre flu titer cnpfisjBrod to, in response to fee coo ox mo*^ mstrocnons 
from (he master control mechanism, perform the following: 

dyMflrfciDy ch an ge fee number of proccssfaig resources m the first su b set of 

dynamically change fee Dumb er of storage resources in the first subset of storage 

dynamically change the conrmrrracatrve coopBpg between fee first subset of 
processing resources and the first subset of storage resources to re flect 
changes in fee number of processing resources in the first subset of 
processing resources sod the m it - i tbcr of storage resources in the first subset 
of storage resources* 

11. A control apparatus as recited in Claim 10, wherein changes to fee number of 
processing resources in the first subset of processing resources and fee number of 
storago resources in the first subset of storage resources is instructed by fee master 
control mnrhftiHsrw based "p"" actual loading *?f fhr tint nibrrt f*f pi criming 
resoorces and first subset of storage resources. 

12. A control apparatus as recited in Claim 1, wherein fee one or more slave control 
mechanisms are further configured to, in r e sp onse to fee one or more instructions 
from fee master control mechanism, establish a wooed logical resource group feat 
co nt a ins a second subset of processing resources and a second subset of storage 
resources, wherem fee second logical resource group is coniiuuriicarivery isolated, 
from the first logical resource group, by: 
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srJncrmg (he second sahset of prtvCa^mg resources from the sot of 
processing resoniT.cj, 

s from the set of processing 



anting the second subset of processing xtsonrcettDbeeonmnxmcatively 
coupled to the second sabset of storage resources. 



13. A control apparatus us recited in Claim 12, wherein: 

Are first subset of processing resources is commtgiicativBry cotrpled to the first 
subset of storage resources using one or more storage area Detwoifc (SAN) 
switches, 

the second subset of processing resources is communicatively coupled to the 
second subset of storage resources using (he one wmcse SAN switches, 
and 

the second logical resource group is CTTmrrmrorjtivcry isolated from the first 
logical resource groep using tagging sod SAN wming. 

14. A control apparatus as recited in Cbmr, 13, whrrein SAN Tu ni n g is performed 
using poit4eveI SAN zoning orLUN level SAN zoning. 

15. A control apparatus as red trxl to Claim 1, wherein: 

the master codrol mechanism is omrrmnrkativery coaled to a central control 



lbs master control mechanism is configured to provide loading i nfor mation fig the 
first logical resource group to fits central control mediaman, and 

the master control mechanism is firrther configured to generate the one or more 
mshuctkms tor the one or more stove control inechemansr 
or more centra] control mstructions received fiom the central control 



16. A method for m a n ag in g p rocessin g resources c»mpriimgffr» ft*^ P g 
toitiating a master control mechanism; and 

ungating one or nxne stove control mcchwriana crrrrmrrmjr^tjwty n-Trplrd to the 
master control nrechanism and being WHifigcred to, in response to one or 
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mare instructions from (he maslca control mechanism, establish a first 
logical resource group that forrt * ITt * a first cutset of processing resources 
and a first subset of storage resources by: 

selecting (he first subset of processing resources from s set of processing 
resources, 

s clo i Jm g the first subset of storage resources from a set of storage 
resources, sod 

siting me first subset of processing resources to be conunniricstively 
coupled to the first subset of storage resources. 

17. A method as r ec i te d in Claim 16, wh erein : 

initiating a master control mechanism incfodes initialing a master control process 

executing on one or more processors, and 
mxtiatmg one or more slave control Tn^fbapiffnTf includes nwriatm^ one oc more 

slave processes executing on (he one or more processors. 



18. A method as recited in Claim 16, wherein: 




19. A method as recited in Gaim 1 6, faru^ comprising master cotnrol 

mncrnrrTTKm dynamically reasrignmg control, based upon slave control process 
mechanism loading, between the one or more slave control mcchamnna, of one or 
more processing resources from the subset of processing resources and one or 
more storage resources from the subset of storage resources. 

2ft. A method as recited m Ctaim lfi, further e nrn f rf^jn g flw martyr rrtntml 

mechanism, based upon slave control process mechanism loading 
dynamjeatry allocating one or more additional slave control mechanism, and 
assigning control of one or more txoccssmg resooreea fim fte subset of 

inw*ssing resources and one or storage rcsmm^fi^ the smwtf of 
storage resourcea to the one or more additional slave control mechanisms. 
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21. A method as mated in Claim 1 6, farther comprising the master conlrol 
mcehamsm. baaed npon ilavc contml pmmat m«rfarm«nj fnn tf fpg^ 

irJSAU Om qi OOUlrp] tD cms at mm ftflw nitre frmtrM rnrrhmitm* fprn *ft- 

more slave control mechanisms of one or more particular processing 
it-source* from the subset of processing r e sou rces and one or more 
particular storage resources ficm tbs subset ofstorage resources that were 
previously assigned to one or more particular shnw ccartrol mechanisms 



22. AmcthcdasieatedmClaim 16,^ 



dete rminin g a ttztos of the one or more slave control me chanism* , 
if one or more particular slave control mechanisms from the one or more slave 
control iTiffiinmsna are not responding or functioning correctly, then 
attempting to restart the one or more particular da ve control mechanisms, 

if the one or more particular slave control mechanisms cannot be restarted, 
men 

initiating one or more new slave control mechanisms, end 
r ea ssig nin g control of processing resources and storage resources 
from the one or more particular slave control mechanisms 
to the one or more new clave control mechanisms. 

23. A method as recited in Claim 16, iurtber comprising the one or more slave control 



determining a states ofthc master control rrtrrfranisrn, and 
if the muter «mt™i mechanism hmt fti led <~ f i tt*» limpr fi™**™mg rOTptrfy, 
electing anew master control mechanism from the one or more slave 
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24. A method ta recited in Cbxm 16, wbertdn the one or more instructions from do 
mmrffr control m«4»«iw i, i i i we ff ai riptwl based upon cipcctnrl processing md 
storage requirements for Ao first logical resource ffoap. 

25. A method es recited in Claim 16, further corrqmsing the- one or mare slave control 
nxxfcarnsma,mresrxxn^ 

medaman, performing fee following: 

dynamically changing die number of processing resources in the first subset of 



dynamically changing the number of storage resources in die first subset of storage 



dynamically changing the communicative coupling between the first xubsct of 
processing resources tod the first subset of storage resources to reflect 
ch mgfts wi the nrnnHrr nf processing nxxircea in the fint subset of 
processing resources md the number of storage resources in the first subset 
of storage resources. ■ 

26. A method as recited in Claim 25, wherein changes to fee number of processing 
s in the first subset of processing resources and the number of storage 
s in the first subset of fttut age resources is mBtmcted by the master control 



A method ts recited in Claim 16, further comprising the one or more slave control 

mechanism, establishing a second logical resource group that contains a second 
subset of processing resources and a second subset of storage resources, wherein 
the second logical resource group is pom u nnicati very i s o la t ed from the first 
logical resource group, by: 

selecting the second subset of processing resources from the set of 



selecting the second subset of storage resources from the set of processing 
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coupled to tho second subset of storage resources. 

28. A method a recited in Claim 27, wherein: 

fee first sublet of procMting re so urc e s « w rmmnnt ftflfpHy i-^ipM ft? rtm frrrt 
subset of storage resources using one or more storage sroa oerwork (SAN) 
switches, 

the second subset of processing resources is ecmmmncsJively coupled tome 
second subset of storage resources using fl*e one ox more SAN switches, 
and 

the second logical resource group is communicatively isolated from tho first 
logical resource group using tagging and SAN zoning. 

29. A method as recited m Claim 23, wherein SAN zoning is performed using port- 
level SAN zoning or LUN level SAN zoning. 

30. A method as recited in Claim 16, wherein: 

the master control mffchtmism is ccmirmmcativery coupled to a central control 



the master control merh/mrrm is configured to provide loading irtfocnation for the 
first logical resource group to the central control mechanism, and 

the masto control mechanism U mrmer configured to 

injunctions for me one or more slave control nwV nimw based upon one 
or rnore central control mstroc^ 



A computer-readable medium carrying one or more sequences of one or more 
rotroctkms for m a naging processing resources, wherein execution of the erne or 
more sequences of one or moro instructions by otic or more processors causes to: 
one or more processors to perform the steps o£ 
mrfiffting a m Biter control nwchamsm; and 

initiatmg one or more slave control rnenTnnismt connnunfcativeh/ coupled to the 



e instructions from the master control mechanism, establish a first 
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logical resource group flint contains a first subset of processing resources 
sad a first subset of storage resooxces by: 



srirrtfrtg the first subset of stm&gs icsouites Hum ft set of storage 



on Kin g tbe first sublet of processing resources to be comniu mcjli very coupled to 
the first subset of storage resources. 
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